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ABSTRACT 

A comprehensive study of the Adult Education for the 
Homeless Program (AEH) was conducted using data from the following 
sources: program files; focus groups conducted with state project 
administrators; site visits to 9 local programs in 3 states; surveys 
of 32 state projects, 230 local programs, 588 service delivery sites, 
and 2,943 program participants; and an assessment of the literacy 
skills of a representative sample of new enrollees at 30 local 
programs. The following were among the study's major findings: AEH 
clients are making progress but still function at a fairly low level; 
establishment of the AEH-created educational services where none were 
available previously; AEH services are offered in residential and 
nonresidential settings, and nearly all local programs have 
implemented aggressive outreach strategies to attract homeless 
participants; AEH clients differ from the homeless population at 
large; the AEH program's limited resources and the high rate of 
mobility among homeless individuals pose formidable challenges to the 
program's ability to meet its clients' educational needs. Appended 
are the following: state-by-state descriptive data, state/local 
surveys; a document literacy test; and statistical methods and 
detailed results of the analyses of client participation and academic 
improvement. Contains 66 tables/figures and 75 references.) (MN) 
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EXECUTIVE SUMMARY 



Despite America's immense wealth, hundreds of thousands of its inhabitants cannot afford 
even the barest essentials of life, and millions more live on the edge of economic despair. The 
most visible of America's underclass are the homeless, living on the nation's streets, in emergency 
shelters, and in other forms of temporary housing. 

This report examines the Adult Education for the Homeless (AEH) Program, one of the 
many programs authorized by the Stewart B. McKinney Homeless Assistance Act of 1987 
designed to address the longer term needs of the homeless. The purpose of the AEH program, 
according to authorizing legislation, is to ''enable each (state) agency to implement a program of 
literacy training and basic skills remediation for adult homeless individuals. . . (Public Law 
100-77, Tide Vn, Sec. 702). 

Employing data derived from program files, focus groups conducted with state project 
administrators, site visits to nine local programs in three states, surveys of 32 state projects, 230 
local programs, 588 service delivery sites and 2,943 program participants, and an assessment of 
the literacy skills of a representative sample of new enroUees at 30 local programs, this report 
provides a comprehensive review of the AEH program in its fifth year of operation. The study 
examines the program's organization and structure, the nature and accessibility of the services it 
provides, the characteristics of those who utilize these services, and various outcomes associated 
with participation in the program. 



Program Outcomes 
AEH clients are making progress, but still functton at a fairly low level. 

• Four in 5 participants accomplished one or more personal goals, 3 in 5 moved up 
from Level I Oimited basic skills competent or functioning at grades 0-8 equivalent) 
to Level II (competent, but not proficie.it, or functioning at grades 9-12 equivalent) or 
within level, 1 in 5 was admitted to another educational program, 1 in 20 received a 
GED, and approximately 1 in 50 received an adult secondary education diploma. 
Among clients enrolling in English as a second language programs, a majority moved 
up one or more ESL levels. 



ERIC 



In the case of clients participating in GED instructional programs (for whom test 
score data are available), average scores increased sigruficandy — by about five 
points — in each of the five GED subject areas. 

On average, clients received training in 8.6 life skills and exhibited ''some*' to ''much'' 
progress in most areas. 

Two in 5 participants obtained or improved their employment, and about 1 in 10 got 
off welfare, registered to vote for the first time, and/or obtained a driver's license. 
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Some program characteristics and instructional practices appear particularly effective. 

• Learners tend to receive more hours of instruction and are more likely to show 
academic improvement in programs with lower student/staff ratios. 

• Individual instruction is a powerful instructional sUategy, and shows consistent, strong 
relationships with academic improvement. 

• Snudl group instruction is more effective in residential sites that require participation 
as a condition of residence than at other types of sites. We speculate that compulsory 
sites have more regular attendance, enabling teachers to develop and implement 
lesson plans appropriate for group instruction. 

• Clients enrolled m more academically oriented programs (ABE, ASE, or GED) tend 
to receive more hours of instruction and have a greater probability of showing 
improvement. 

• Clients enrolled in programs with fewer students per staff member tend to remain 
longer show more improvement. 

• Despite instructor's expectations to the contrary, clients at residential sites performed 
no better than clients at non-residential sites; and 

• Also confounding instructors expectations, clients at compulsory sites received no 
more hours of instruction than clients at non-compulsory sites, and fared no worse 
academically. 



Organizatioii and Stni cture of the AEH Program 

The establishment of the Adult Education for the Homeless (AEH) program provided 
educational services where none were available before. 

• Prior to the establishment of the Adult Education for die Homeless (AEH) Program, 
in 1987, only one state provided educational services for homeless adults through a 
program administered at the state level. Locally, most programs funded through AEH 
had either not existed or had not provided educational services specifically targeting 
the homeless. 

• Over tfie past five years, the AEH program has expanded services significantiy. In its 
first year of operation, die program served only 18,000 homeless adults nationwide. 
However, by 1992, AEH provided services to nearly 50,000 clients, or approximately 
1 in every 10 homeless adults in tfie United States. These figures arc all the more 
impressive when one considers tiiat AEH appropriations have increased by only 42 
percent during the same five-year interval. 
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• In 1992. the AEH program funded projects in 35 states in support of some 282 local 
programs. In turn. local AEH programs administered the delivery of services at some 
776 service dehveiy sites - e.g.. emergency shelters, transitional housing, drue 
rehabihtation centers, community coUeges. libraries, and other locations. During the 
program year, each local program served an average of 180 clients and each site 
served an average of 70. u^wimw 

Most funding for AEH projects comes from AEH funds, though many projects have 
leveraged substantial funding from other sources. y projecis nave 

• In 1992. state projects received some $9.8 million in AEH funds to support 
educational programs for homeless adults at the local level. Grants ranged in size 
from $101,239 to $600,000. averaging approximately $285,176. Some states 
supplemented Federal grant money with funds from other sources. 

• About one in three AEH projects were recipients of supplementary Adult Education 
Act fmds (averaging $208,634) and another 1 in 10 projects received supplementary 

SbS^^ E^enTtlS °^ ^"'^^^^ ^"^^"'^'''^ 

In 1992. local AEH programs received state grants ranging from $300 to $300,000 «n 
one instance), averaging some $31,327. In addition, approximately 44 percent of 
l^nJJ^'^' supplementary funds from non-AEH sources, averaging 

$30,069 Many programs also benefited from in-kind support, especially in the form 
of volunteer services and donations of space and materials. 

-dministrators support local programs in their efforts to provide educational 
services m several ways. cuuuiuuniu 

• All states provide technical assistance and monitor the development of local 
programs. In addition, the majority of states support slaff development at the local 
level, develop and disseminate curricula, and conduct local program evaluations. 

' Seve? fon^lS ^" additional 

• All states coordinate services with various otiier Federal programs, including the 
Adult Education Program. Homeless Children and Youtii. JTPA. JOBS. Ev«i Start 

• In 1992, state-level administrative costs accounted for some 13 percent of total 
expenditures. 

^cSuTJCT" ""^"^'^ f"« • of ch.ii«Mi« to buttdtog 
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• Uncertainty regarding Federal ftinding ranks first among the concerns of state project 
administrators — nearly 9 in 10 cited this as one of the three most important 
challenges that they face. Inadequacy of funding and delays in funding were also 
cited as major concerns at the state level 

• State project administrators also expressed a desire for increased technical assistance, 
especially in the areas of curriculum and assessment 

^ At the local level, the most critical challenges are those relating to the specific nature 
of homeless clients — e.g., their transiency, low self-esteem, lack of commitment, etc. 



Accessibflitv of Services 

The AEH program^ which provides services in communities of every size, ofFer services in 
both residential and non»residential settings. 

• The vast majority of service delivery sites (about 71 percent) are ••residentiary sites — 
i.e., locations where homeless people seek temporary shelter. The remainder are 
••non-residential** sites, such as adult learning t:enters, community centers, school 
classrooms, etc. 

• More than one-third of residential sites impose no specific maximum stay limitations, 
about two in five residential sites permit longer than normal stays for residents 
participating in ti\e AEH program, and the vast majority allow clients to continue in 
the AEH program after discontinuing residence. (Unfortunately, in one-half of the 
sites that permit continued participation, less than 10 percent of clients avail 
themselves of this opportunity.) 

• Administrators of programs serving both residential and non-residential sites rated 
residential settings more effective ;.'an non-residential settings by nearly a two-to-one 
margin, although both types of sites were perceived to have specific advantages. 

Nearly all local programs have implemented aggressive outreach strategies to help attract 
homeless participants, who often lack the self confidence to seek educational opportunities 
spontaneously. 

• Key outreach strategies include interagency referrals, personal contacts, and other 
methods. 

• Approximately three-fifths of service delivery sites also use incentives to reward 
clients for participating in the AEH program, such as certificates of achievement, gifts 
of clothing, or other personal effects. 

• About one-third of residential sites link the provision of shelter to participation in the 
AEH program. Overall, about one-third of clients participate on a compulsory basis. 
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• About 65 percent of those who administer programs that provide services at both 
compulsory and non-compulsory sites express the opinion that required participation 
results in greater duration and intensity of instruction^ Yet. more than one-third of 
these same administr^ u)rs perceive clients enrolled on a compulsory basis to be less 
motivated than those who participate voluntarily, and only one in four associate 
compulsory participation with greater client motivation* 

Programs ofTer a wide array of support services to help meet the broad needs of clients. 

• About three-quarters of the clients participating in the AEH program leceive 3 or 
more support services, and more than 10 percent receive 10 or more such services. 

• Case management services, as well as the essentials of food, shelter, and clothing, are 
provided by about 9 in 10 local programs. Among these, the most utilized is case 
management, reflecting its central role in the support services network. 

• Also widely available — diough utilized by only one-tenth to two-fifths of 
participants — are substance abuse counseling, mental health counseling, health care, 
child care, transportation, legal assistance, and various support services aimed at 
enhancing clients* chances of becoming gainfully employed. 



Program Participante 
AEH clients differ from the homeless population at large* 

• In terms of sex and family status, the two groups differ markedly. Only 55 percent 
of AEH participants are male, as compared with 81 percent of all homeless adults, 
and. while the vast majority of homeless (82%) are unattached adults. AEH 
participants include substantial proportions of single parents (25%) and two-adult 
families with dependent children (10.6%). 

• About 86 percent of AEH clients were unemployed at enrollment (compared with 94 
percent in the larger homeless population) and. on average, they had bwn without 
steady work for 13 months (compared with four years in the homeless population at 
large). 

• The average AEH participant had been homeless for just seven months at cnrolteient, 
while, in the greater homeless population, the average duration of homelessness is 
more than three years. 

^ About one*third of all sites provide services to recovering substance abusers, another 
one in 10 serve victims of abuse, and approximately eight percent serve the mentally 
ill. While data collected for this study do not permit precise estimates of the 
proportion of AEH clients with problems of drag abuse, domestic violence, or mental 
illness, it is possible to gain some sense of the proportion of program participants 
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with personal problems of this nature by examining the distribution of sites targeting 
these groups. 



Clients served typically function at a low educational level. 

• Approximately 17 percent of AEH participants have eight years of education or less, 
75 percent have between 9 and 12 years of education, and roughly 8 percent have 13 
or more years of education. (Although AEH participants have somewhat less formal 
education than diose in the greater homeless population — about one-fiAfa of whom 
have 13 or more years of education — this is almost certainly a function of AEH 
eligibility requirements.) 

• AEH clients are approximately evenly divided between the two achievement levels — 
about 45 percent at Level I (eighth grade or less) and 55 percent at Level n (ninth 
through twelfth grade). 

• A majority of participants exhibit proficiencies at the TALS Levels 1 and 2 (these 
levels are different than the levels mentioned above. TALS developers suggest that 
skills evident at these levels place severe restrictions on an individual's ability to 
participate fully in the labor force). 

• Nearly one in five participants exhibit proficiencies at TALS Level 4. Individuals 
scoring at this level demonstrate proficiencies in coping with the kinds of complex 
literacy tasks that are increasingly conunon in the workplace and, thus, would appear 
to represent an untapped resource for the U.S. economy. 

• When the range of TALS scores for clients enrolled in the AEH program is compared 
with those for representative samples of Job Training Parmership Act (JTPA) eligible 
applicants and Employment Service/Unemployment Insurance (ES/UI) participants, 
the three distributions are strikingly similar. This is consistent with the view that 
homelessness is not sunply a function of poor literacy skills, but involves other 
variables as well, including personal i^blems of addiction, mental illness, and abuse, 
as well as the lack of adequate social supports. 



Educational Services 

The AEH program's limited resources and the high rate of mobility among homeless 
individuals pose formidable challenges to the program's ability to meet the educatiomil needs 
of its clients. 

• The average local program spends just $291 in AEH fiinds to provide services to each 
of its clients, and, in some areas, where demand is greatest, program expenditures 
average as little as $7 per client. 

• While almost one-third of program participants receive more than 40 hours of 
instruction, nearly two-fifths receive 10 hours or less. 
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The AEH program emphasizes mstnictiomil programs that mtegrate basic skills with life 
skills training and other programs specifically designed to meet the affective needs of 
homeless clients. 

• Life skills training programs are most widely available — at four in five sites — 
followed closely by programs in adult basic education, GED preparation, self-esteem 
development, and employability skills. In addition, about one in four sites provide 
instruction in English as a second language and adult secondary education. 

• Demand for life skills training programs — as indicated by enrollments — is nearly 
twice that for any other instructional area, and demand for programs addressing the 
affective needs of clients ranks second. Somewhat fewer clients participate in 
programs in adult basic education, employability skills, and GED, and fewer still 
receive instruction in adult secondary education and English as a second language. 

At most AEH service delivery sites, a broad range of instructfonal approaches and strategies 
is employed. 

• Individualized instruction is the most widely utilized instructional approach — 
employed at 9 in 10 sites — and, also rated the most effective. (Small group 
instruction is employed by nearly as many sites, but less highly rated in terms of 
effectiveness.) 

• Workbook-based instmction is the most widely utilized strategy of instruction — 
employed at nearly 9 in 10 sites — and, also rated the most effective. Cooperative 
learning ranks second in both prevalence and perceived effectiveness. 

Because of the AEH program's emphasis on individualized and small group instruction, 
instructional materials are often customized to meet the needs of individual learners or 
groups of learners* 

• Although, on average, state projects allocate less than 1 percent of budget to 
curriculum development costs, two-thirds have developed curricula designed for use 
with homeless adults. 

• Most states have focused attention on the development of instructional materials for 
families and single women with children, while fewer have developed curricula for 
victims of spousal abuse, single men, substance abusers, and other groups. 




CHAPTER I 

THE ADULT EDUCATION FOR THE HOMELESS 
PROGRAM IN PERSPECTIVE 

Introductioii 

Despite America's immense wealth, hundreds of thousands of its inhabitants cannot afford 
even the barest essentials of life, and millions more live on the edge of economic despair. The 
most visible of America's underclass are the homeless, living on the nation's streets, in emergency 
shelters, and in other forms of temporary housing. 

Though homelessness is not a new phenomenon, its persistence over the past decade has 
heightened public awareness and concern. Still, the dimensions of the problem continue to grow. 
In 1984, the Department of Housing and Urban Development estimated that there were between 
250,000 and 350,000 homeless people in the United States (HUD, 1984). Just three years later, a 
study by the Urban Institute found that the number had grown to between 500,000 and 600,000 
(Burt and Cohen, 1989). This latest estimate places the rate of homelessness at roughly 20 to 25 
homeless persons for every 10,000 Americans. 

Reliable estimates are not available, but the impact of the recession of the early 1990s 
seems to have further exacerbated the problem. A survey conducted recently for the Federal 
Emergency Management Agency's (FEMA) Emergency Food and Shelter Program found that, 
during the six-month interval period between August 1991 and February 1992, 90 percent of local 
boards and recipient organizations experienced an increased demand for services, and three out of 
four reported that demand had increased by at least 30 percent (CRS, 1992). 
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Characteristics the Homeless 

While the rate of homelessness seems to be rising, press reports of a growing number of 
*'new homeless'' — two parent families and individuals whose homelessness can be attributed to a 
sudden change in economic circumstances — are not supported by the evidence. The bes^ 
available data (Burt, 1992) suggest that homeless households consist predominantly of single 
adults living alone (82%), followed by single parents with dependent children (9%), and adults 
living with partners but no children (8%). The remainder, adults living with partners and 
children, comprise only about one percent of all homeless households. These same data indicate 
that only about one in ten homeless persons report having held a steady job in the past three 
months, and the average duration of unemployment is tour years. 

The homeless are not a microcosm of the larger society, as. some observers would suggest 
(Bailis et al., 1991). They are disproportionately male (81%), black (41%), and poorly educated 
— almost half lack even a twelfth-grade education (Bmi and Cohen, 1989). About one-third are 
severely mentally ill, one-third or more have serious substance abuse problems, and more than 
half have served time in the nation's jails and prisons (Interagency Council on the Homeless, 
1989). Social isolation and a lack of family ties also characterize the homeless. In a study of 
people who frequent soup kitchens and other emergency food programs in Chicago, three factors 
were found to be critical in discriminating between those who had and had not ever been 
homeless: living alone, alcohol abuse, and having been in out-of-home placement as a child 
(Sosin, Colson, and Grossman, 1988). Another study, based in Minneapolis, found that nearly 
two in five homeless respondents had been in foster care as children (Piliavin, Sosin, and 
Westerfelt, 1987). In addition to these attributes, the homeless also suffer from psychological 
distress at rates dramatically higher than the population at large. Using the CES-D depression 
scale developed by the Center for Epidenuological Studies, Burt (1992) found that about one-half 



of the homeless in her sample were sufficientiy demoralized or depressed to warrant immediate 
clinical attention. Even more striking, she found that more than one in five had attempted suicide, 
as compared with the national average of about three percent. 
Public PoBcv: The McKlnnev Act 

Explanations of the recent increase in the rate of homelessness abound. Initially, blame 
fell on the 1981-1982 recession, its attendant rise in unemployment, and the policies of the 
Reagan administration. As the recession passed, with no abatement in the rate of homelessness, 
some began to attribute blame to the homeless themselves, pointing to their problems of substance 
abuse, mental disorder, and criminality (Butler, 1989). Others focused on structural explanations, 
such as the shift in the economy from manufacturing to services, housing shortages, the 
decreasing purchasing power of public benefits, and the deinstitutionalization of the mentally ill 
(Burt, 1992; Rossi, 1989; Hartman, 1986). 

Increasingly, it has become clear that homelessness cannot be attributed to a single 
cause — both individual and societal factors contribute to its enduring nature. Certainly, personal 
vulnerabilities increase the likelihood that some individuals, rather than others, will become 
homeless. However, without sustained macro-level policy interventions, and pcriiaps a 
fundamental restructuring of the economy, we are unlikely to see the eradication of homelessness 
in America in the inunediate future. 

Because homelessness was initially considered a short-term emergency, not a deep-rooted 
socioeconomic problem. Congress first responded by creating the Emergency Food and Shelter 
Program as part of the Jobs Bill of 1983, placing the program in the Federal Emergency 
Management Agency (FEMA). In 1987, Congress continued this approach by creating the 
Emergency Shelter Grants Program to expand the size of the shelter system. Later in that year, 
this program was folded into a much more comprehensive piece of legislation, the Stewart B. 
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McKinncy Homeless Assistance Act of 1987. The McKinney Act was the first piece of federal 
legislation to acknowledge that homelessness is more than a housing problem and to address the 
longer term needs of the homeless. The Act authorizes some 20 programs, administered by seven 
federal departments* that provide not only housing assistance, but also food assistance, health and 
mental health care, substance-abuse treatment, education, and job training. 
The Adult Education for the Homeless Program 

This report examines one of the many programs authorized by the McKinney Act, the 
Adult Education for the Homeless (AEH) Program, administered by the U.S. Department of 
Education. The AEH program represents the first fed^ initiative aimed specifically at the 
educational needs of homeless adults. The purpose of the program, according to the authorizing 
legislation, is to **enable each (state) agency to implement a program of literacy training and basic 
skills remediation for adult homeless individuals. . (Public Law 100-77, Title VII, Sec. 702). 

Since its inception, in 1987, the AEH program has awarded nearly $50 million to states 
for services to more than 150,000 homeless adults. In its first two years, the program funded 
projects in all 50 states on a formula basis. In 1989, Congress revised the program*s delivery of 
Federal assistance by changing the grant process to a discretionary system that is intended to 
increase accountability by providing funding only to those states with the most competitive project 
applications. 

This report provides a review of the AEH program during its fifth year of operation, 
examining its organizational structure, staiTmg, evaluation procedures, and the nature of the 
educational and support services that it provides. While two previous reports — compiled ft-om 
reports submitted to the U.S. Department of Education by participating states — have examined 
the program, this represents the first comprehensive review based on comparable data collected at 
both the state and local levels. 
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Review of State AEH Project Reports and Related Literature 



Most of what is currently known about providing educational services to the homeless is 
derived from State AEH Project Reports, submitted annually to the U.S. Department of Education, 
two Federal reports summarizing this information (U.S. Department of Education, 1990, 1992), 
and published evaluations of related programs, such as the Job Training for the Homeless 
Demonstration Program (Bailis, Blasinsky, Chesnutt, and Tecco, 1991) and the Special 
Demonstration Project on Literacy Training for the Homeless, funded under Section 353 of the 
Adult Education Act (Spanard, 1990). Insights derived from these sources have helped to inform 
the development of this study and provide a useful context for interpreting results. Thus, we 
begin by examining what is already known, fixsU about providing educational services to the 
homeless generally and, second, about the AEH program specifically. This review centers around 
four principal topical areas: 

• Characteristics of the r.)opulation served; 

• Program organiz3tio:i and management; 

• Educational services; and 

• Educational outcomes. 
Characteristics of the PoDulation Served 

State AEH Project Reports and U.S. Department of Education reports that examine the 
AEH program as a whole provide the basis for a characterization of AEH participants. The 
demographic and educational characteristics of participants are sununarized briefly below: 

• Age of Participants. The majority of AEH program participants are between the ages 
of 25-44. More middle-aged and older adults (45 years of age and older) are served in 
sun-belt states, such as Florida, Texas, California, Georgia, and Alabama. However, 
nationally, only about two percent of program participants are 60 or older. 

• Sex of Participants. A majority of program participants arc male, though in several 
states — e.g.. West Virginia, Kansas, and Michigan — females outnumber males by 
wide margins. 
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• Race/Ethnicity of Participartts. Most program participants are white (about 46%), 
followed by blacks (about 35%), and Hispanics (about 16%). Other groups — 
including Native Americans and Asians — represent approximately three percent of the 
population served. 

• Educational Level of Participants. Among states reporting the educational level of 
participants, more than one*half served a majority of Level I students (limited basic 
skills competent or Amctioning at grades 0-8 equivalent), while the remainder served a 
majority of Level n students (competent, but not proficient, or functioning at grades 
9-12 equivalent). 

A general taxonomy of the homeless population, developed by the Volunteers of America 
of Greater New Ycrk, is employed by several AEH programs across the country (Business 
Council for Effective Literacy, 1988). According to this classification scheme, the homeless 
population is divided into three groups — the situationally homeless, the marginally homeless, and 
the chronically homeless. Each subpopulation is described briefly below. 

Situationally Homeless 

The situationally homeless are those individuals who have been dealt an unexpected blow, 
such as a major medical expense or sudden job loss, which temporarily renders them homeless. 
This population generally can return to normality in a short time, although they find themselves 
temporarily in a state of crisis. The most basic needs of situationally homeless adults are housing, 
job referral, and a return to stability. 

Marginally Homeless 

The marginally homeless are those individuals who drift in and out of homelessness 
repeatedly. This group includes high school dropouts, single-parent families, teen mothers, non- 
English-speaking inmiigrants, migrant workers, victims of spousal abuse, and substance abusers. 
The marginally homeless require comprehensive help and support systems to return to mainstream 
society, including psychological and career counseling, life-skills training, and, in some cases, 
treatment for drug addiction. 
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Chronically Homeless 

The chronically homeless include those individuals with severe psychological impainnenU 
the destitute elderly, and others requiring lifelong supervision or institutionalization. These people 
generally require community-supported facilities designed to address their long-term needs* 

Understanding the characteristics of the homeless included within each of these categories 
is useful because it may influence the types of services provided by AEH projects, as well as 
determine how to define successful program outcomes. There is widespread acknowledgment in 
the literature that shelters which focus on particular subgroups within the homeless population 
must have instructional programs designed to meet the needs of the target population, whether 
they be single men or women, single parents with children, families, limited English proficient 
populations, or some other subpopulation (WesseUus, 1990). 
Program Organization and Management 

Three aspects of program organization and management are most often addressed by the 
State Project Reports and related literature: (1) location of AEH services; (2) staffing; and 
(3) coordination of services* 

Location of Services 

Program services provided through the AEH program generally are located on site at 
residential shelters. Both on- and off-site programs tend to employ traditional delivery systems, 
such as community colleges, to manage educational services. Off-site services are generally 
offered within the context of adult education or literacy programs and typically are located at 
community colleges, schools, or community-based organizations. Clients are referred to these 
services by shelter staff and instruction is generally targeted for homeless adults. 
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The choice of off- or on-site training depends both on the characteristics of clients and a 

program* s philosophy. Administrators of the Volunteers of America (VOA) Program in New 

York City, for example, believe that all services should be brought to the client: 

In most cases today, services for the homeless are piecemeal. People are expected 
to go to one place for a meal, another for medical attention, another for clothing, 
anotlier for housing help, another for tutoring. This is especially hard in areas 
where transportation is not easily available and when people are worried about 
where they will spend the night. All of VOA*s programs for the homeless are 
multiservice and 90 percent of its clients* needs are met at the shelters. Education 
efforts have the greatest chance of success if they take place where people get 
24-hour help. (VOA, 1988) 

The Washington State AEH project also adopts this philosophy. Providing services where 
homeless people congregate is, according to Project administrators, one of the key elements of a 
successful program (Washington State AEH Annual Report, 1991). On the other hand, programs 
offering on-site instruction have found that some students are embarrassed about admitting to 
others that they do not know how to read (Spanard, 1990). Apparently, for many illiterate 
homeless, the lack of basic educational skills is a carefully hidden secret. The decision about 
where to locate a program raises a number of additional issues. On-site programs often suffer 
from a lack of space, security, or even a supportive staff within the shelter itself (Spanard, 1990), 
while off -site programs may fail if transportation is not provided (Potts, 1989). 

Staffing 

Since the inception of the AEH program, about one-half of all staff members have been 
volunteers (U.S. Department of Education, 1990). Teachers comprise the majority of program 
personnel (59%), followed by paraprofessionals (30%), and counselors (11%). Although states 
often require teacher certification — either fn elementary/secondary education or adult education 
— staff training designed to ensure greater sensitivity to the needs of homeless clients is equally 
important. The Wisconsin project (Wesselius, 1990) stresses the need for ongoing staff training 
and support from administering institutions (e.g., community colleges). Several states — New 
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York, New Hampshire, California, and Maryland, for example — provide staff development 
activities directly. 

Case management is another essential element of a successful program, according to most 
reports. Case managers serve as confidence builders and advocates. They also provide the 
critical follow-up necessary for clients* success in these programs. Finally, they play an 
especially vital role in assisting clients as they make their way through the often bureaucratic 
maze of support service networks (Pelzcr, 1990). 

Project administrators in Maryland single out the use of mentors as a critical element in 
the success of that state*s program. Serving a role similar to case managers, mentors become 
friends, advocates, and counselors of program participants. CUents interviewed in Maryland have 
indicated that their mentors are essential in helping them to deal with crises in their lives and in 
enabling them to prepare for a more successful future (Morros, 1991). 

Coordination of Services 

Because of the nature and characteristics of homeless clients, AEH programs require a 
multi-faceted delivery system with coordination of services such as housing, child care, 
employment, education, and counseling (Bailis et al:, 1991). In its recommendations for 
successful programs, Washington State underscores the importance of service coordination 
(Washington State AEH Annual Report, 1991). In Georgia, the establishment of a Statewide 
Special Populations Interagency Advisory Council has assisted greatly in enhancing the visibility 
of the AEH program and in providing for the coordination of needed resources and services 
(Georgia AEH Final Report, 1990). Administrators in all states concur that coordination offers 
the means of providing support services to AEH clients that might otherwise be unavailable to 
them. 
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Educational Services 

The delivery of educational services is central to the niission of all AEH programs. State 
Project Reports and related literature describe various methods of recruitment, retention, screening 
and placement, as well as a wide range of program structures, curricula, and instructional 
approaches. 

Recniitment 

Recruitment strategies include the use of flyers and brochures (Wesselius, 1990), 
networking with social service agencies (Indiana Annual Report, 1990), interpersonal outreach, 
and other methocls of informing potential clients about the AEH program. Several programs in 
Washington State indicated that a shortage of shelter beds prevented the recruitment of a 
significant number of homeless individuals who could have benefitted from AEH services 
(Washington State AEH Annual Report, 1991). 

Retention 

Given the transient nature of homeless clients, retention is a major concern for educational 
programs serving this population. Administrators of the Maryland Project have reconunended the 
elimination of time restrictions on shelter stays for AEH clients as a means of promoting greater 
educational gains (Morros, 1991). Otiier programs continue to provide educational services to 
clients after they leave residential sites. For example, a St. Lx>uis program, fimded under the 
Adult Education Act, has increased its retention rate by providing educational services (as well as 
transportation and child care) for a period of one year following clients' departure from shelters 
{Spanard, 1990). Similarly, the Job Training for the Homeless Demonstration Program provides 
follow-up service to its clients for at least 13 weeks after job placement (Bailis et al., 1991). 
Finally, some programs have experimented with the use of incentives, such as food, clothing, or 
other gifts, to encourage participation (Moehrlin, 1991; Spanard, 1990; Potts, 1989). 
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Scrtenine and Placement 

Programs providing educational services to the homeless regularly describe the critical 
nature of a comprehensive intake procedure, coupled with the establishment of individual 
educational plans (lEPs) for all clients. However, adult education programs have traditionally 
avoided subjecting tiieir students — who have often experienced failure in other school settings — 
to formal testing procedures. This issue is compounded in the case of die AEH progrum, where 
clients are often in a state of crisis at enrollment. Program coordinators are sensitive to the need 
to provide positive reinforcement for clients entering tiiese programs and hesitate to subject tiiem 
to any additional stress through tiie administration of tests. Thus, informal instruments, state or 
locally developed measures, open-ended interviews, and otiier relatively subjective diagnostic 
procedures are commonly used to place cUents (Washington State AEH Annual Report, 1991). 

When standardized assessments are used, tiiey typically include tiie Adult Basic Learning 
Examination (ABLE), tiie Test of Adult Basic Education (TABE), tiie Wide Range Achievement 
Test (WRAT), and tiie Comprehensive Adult Student Assessment System (CASAS). Otiier, less 
commonly used assessments include tiie VALPAR work sampling assessment tool (Bailis et al., 
1991), tiie SLOSSON Interest Inventory (New Hampshire Annual Report, 1990), and tiie CAPP, 
an adaptation of tiie CASAS (Connecticut AEH Annual Report, 1991). 

The AEH Project in California employs standardized assessments more extensively tiian do 
mf'st otiier states. Seven local programs in California make use of vocational assessment surveys 
and tiie Employability Competency System (ECS), a modified version of CASAS. Between 
January 1 and June 30 of 1989, some 840 clients completed Goal Attainment Surveys, and, of 
tiiese, 542 were administered tiie ECS.' Almost one-half (45.2%) of tiie participants tested 

' Attrition accounted for tiie difference in tiie numbers surveyed and tested. Clients completed 
tfie Goal Attainment Survey at intake, while tiie ECS was administered later in tiie enrollment 
process. 



functioned at or above the beginning high school reading level. According to test developers, 
these individuals are capable of following oral and written directions in both familiar and 
unfamiliar work situations. In math, however, the vast majority of participants (76.1%) tested 
below the beginning high school level. These individuals will have difficulty with anything 
beyond basic computational skills (CASAS, 1989). 

As part of the Goal Attainment Survey, clients were asked to identify their reasons for 
enrollment. Educational goals were cited most often (44.3%), followed by goals pertaining to 
employment (29.7%) and personal/conununication issues (26.4%). Nearly three in four clients 
attained their goals, while the remainder encountered barriers to goal completion (CASAS, 1990). 

Content of Instruction 

An important element of many successful programs is a curriculum that is grounded in a 
functional context. Effective programs typically offer instruction in performing practical tasks, 
thus providing assurance to clients that there are tangible benefits associated with program 
participation (U.S. Department of Education, 1990). Curriculum often consists of traditional 
instruction in Adult Basic Education, GED preparation, and English as a Second Language, 
combined with life skills training, self-esteem workshops, and instruction in decision making. 
Many programs also offer instruction aimed at enhancing the en:ployability of clients (Rowe, 
1991; Moehrlin, 1991; Pelzer et al., 1990; and Potts, 1989). At least two states, Washington and 
North Carolina, have developed curricula specifically designed to meet the needs of homeless 
clients. The former uses a simplified version of the Washington State Core Competencies 
(Washington State AEH Annual Report, 1991) and the latter has developed a curriculum aimed at 
recovering substance abusers that incorporates literacy instruction within the 12-step program of 
Alcoholics Anonymous (North Carolina AEH Annual Report, 1991). 
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Instructional Approaches 

A variety of program structures have been adopted by AEH providers and other agencies 
serving the homeless. Several programs began as drop-in centers, but eventually developed more 
extensive services, including counseling and short-term course offerings (Potts. 1989; Simon. 
1987). Many programs continue to operate on an open entry/open exit basis due to the transient 
nature of . the population served (Wesselius. 1990). 

Various instructional approaches are in use. including individualized, small group, 
intergenerational. and computer-assisted instruction. The use of '*peer coaches** to assist in 
tutoring has proven particularly effective in one Pennsylvania program (Veghts et al.. 1990). The 
Travelers* Aid Program in Rhode Island has found its client-produced newsletter to be an 
effective means of developing both writing skills and self-esteem (Rhode Island AEH Annual 
Report. 1990). Finally. Washington State AEH Project administrators cite several approaches that 
help to ensure a successful program: (1) instruction in modules requiring between one and four 
hours to complete: (2) therapeutic education (healing through self-expression); (3) individualized 
and interactive instructional modes; and (4) culture/class sensitivity exercises (Washington State 
AEH Annual Report, 1991). 
Educational Outcomes 

Although individual successes are conunon. a large-scale demonstration of successful 
outcomes has remained an elusive goal of the AEH program. In part, this is due to the transient 
nature of the population servec?. The short-term participation of many clients all but precludes the 
effective application of standardized assessment instruments. Several examples illustrate this 
point: 

• Connecticut attempted to employ a competency-based assessment system requiring 
post-tests after 75 hours of instruction, but found that only 3 of 100 clients completed 
the requisite number of hours (Connecticut AEH Annual Report. 1991); 



• New Hampshire reported that only 1 in 20 clients were available for testing after 30 
hours of instruction, again because program participation was of such short duration 
(New Hampshire AEH Annual Report, 1990); and 

• Washington State reported that 166 of 586 learners separated from the AEH program 
before achieving their goals. Of this number, 69 percent left because they were forced 
out of an emergency shelter at which they temporarily resided (Washington State AEH 
Annual Report, 1991). 

In addition to the transient nature of the population served by the AEH program, other client 
characteristics may present barriers to the effective use of standardized assessments. For example, 
local programs in Kansas, where an estimated 40*^ percent of clients are special education 
students, have found it difficult to measure outcomes due to the low reliability and validity of 
tests developed for these students (Kansas AEH AmiivJ Report, 1991; Colarusso, 1987). 

Most AEH programs stress the importance of accon^lishments in life skills areas such as 
budgeting, job seeking, and personal hygiene, but program administrators seldom formally 
evaluate outcomes in these areas. Self-esteem enhancement and decision-making skills also 
represent important components of instruction, but, again, outcomes are rar ly assessed. Some 
programs do report impressive educational gains, however. In New Hampshire, 40 percent of 
program participants worked toward the GED, and 17 percent were successful (New Hampshire 
AEH Annual Report, 1990). In Washington State, a program serving Airican-American youth 
between the ages 16-24 reported that two in five clients found jobs and more than one-third 
entered another education or training program (Washington State AEH Annual Report, 1991). 
Prior to their involvement with the AEH program, many of these youths had been gang members 
engaged in drug dealing, prostitution, and protection rackets. These and other illustrations of the 
success of the AEH program abound. What is lacking is a systematic, across-the-board 
accounting of program outcomes based on a universally applied standard of measurement. 
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Overview of the Report 

While individual State Project Reports and otiier sources of information provide useful 
insights into the operation of the AEH program and the various services that it provides, this 
report represents the first systematic review of the program based on comparable data collected at 
both the state and local levels. 

Beyond this introduction, the study is divided into eight substantive chapters. Chapter n 
addresses several methodological issues and examines the two principal sources of data upon 
which the study is based: (1) the State Project and Local Program surveys and (2) a literacy 
assessment of new enroUees at some 30 randomly selected local programs. In Chapter m, 
information concerning the organization and structure of the AEH program is presented, including 
a discussion of: (1) the structure of the AEH program; (2) administrative and program staff; 
(3) state project and local program finance; (4) program monitoring and evaluation; and 
(5) challenges to development and implementation. Chapter IV investigates the accessibility of 
services provided through the AEH program, focusing on: (1) the location of services, including 
their geographic distribution and the perceived effectiveness of residential and non-residential 
sites; (2) outreach methods, incentives for participation, and the perceived effectiveness of 
compulsory versus voluntary program structures; and (3) the availabiUty and utilization of support 
services. Chapter V offers a description of the clients served by the AEH program, including 
their demographic characteristics, educational level, employment status, and the duration of their 
homelessness. This chapter also reports information on the baseline literacy scores of program 
participants, derived from the administration of the TALS Document Literacy Test to a sample of 
new program enroUees. In Chapter VI, a description of the various services provided through the 
AEH program is presented, focusing on: (1) the intensity and duration of services; (2) the content 
of instructional programs; and (3) the various instructional practices and curricula employed in the 




delivery of services. Chapter Vn exaxnines program outcomes — both educational achievements 
and other accomplishments. Ch^ter Vm explores the relationships between educational 
outcomes and program structures, instructional practices, and client characteristics. Finally, 
Ch^ter IX provides a brief discussion oif the study's key findings and develops a set of 
guidelines for state and local administrators to follow in evaluating the AEH programs in their 
particular state or locality. 
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CHAPTER n 
METHODOLOGY 



Overview 

This study is designed to provide a sys .ematic review of the operation of the Adult 
Education for the Homeless Program and the services that it provides to homeless adults across 
the United States. The study has three underlying objectives: 

• To provide comprehensive descriptive information about the AEH program that can be 
used by administrators at the Federal, state, and local levels to improve the program; 

• To examine the range of literacy skills among program participants; and 

• To identify possible procedures and methods that AEH projects may use in evaluaUng 
their operation and services. 

Two principal sources of data are employed in this investigation: (1) a nationwide survey 

of the universe of AEH state projects and local programs; and (2) a literacy assessment of new 

enrollees at 30 randomly selected local programs. Each source of information is described below 

— including details of survey development and design, test selection, sampling, and data 

collection — followed by a brief methodological note pertaining to the interpretation of results. 

State and Local Surveys 

Survey Development 

State and local surveys were developed through a process involving several steps: (1) a 
review of relevant literature; (2) an examination of AEH program files; (3) focus groups 
conducted with state project administrators; (4) site visits to nine local programs in three states; 
(5) survey pre-test interviews with selected state and local administrators; and (6) a review of 
draft surveys by the U.S. Department of Education and the Office of Management and Budget. 

„ 36 



Literature Review 

State AEH Project Reports, U.S. Department of Education descriptive summaries, and 
published evaluations of related programs were reviewed to provide a preliminary framework for 
the development of the two surveys. The information derived from this review was useful in 
highlighting many of the key issues related to the program's operation and services and in 
identifying areas where additional information was required. The principal findings of the 
literature review are summarized in Chapter I. 

Review of Program Files 

U.S. Department of Education program files for each of the 35 AEH projects funded in 
1992 also were examined, and relevant data were extracted. These data are presented in 
Appendix A in the form of four summary tables that provide information in the following areas: 
(1) characteristics of target populations served; (2) organization of services; (3) educational 
programs; and (4) evaluation procedures. 

Beyond providing additional insights relevant to the design of the two surveys, these tables 
represent a useful compendium of information describing the AEH program on a state-by-state 
basis. Because of their dual purpose, some of the information contained in these tables has been 
updated to reflect survey data. (Information derived from the surveys is noted as such in 
Appendix A.) 

Focus Groups 

As part of the survey development process, focus groups were conducted with state project 
administrators at the Second National Conference on Adult Education for the Homeless. Groups 
were formed based on the principal subpopulations targeted in each state — e.g., recovering 
substance abusers, victims of spousal abuse, mentally ill, etc. — and discussions were organized 
around six topical areas: (1) outreach methods; (2) placement and assessment; (3) curricula; 
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(4) instructional approaches; (S) measurei^ of success; and (6) program evaluation. This approach 
was employed to focus discussion on the specific organizational structures and practices that have 
proven effective in providing services to each subpopulation. The views expressed during these 
discussions were particularly useful in identifying areas of concern to program administrators at 
the state level. 

Site Visits 

As an additional step in the development of the two surveys, site visits were conducted at 
nine local programs in three states. Sites were selected to represent a broad range of AEH 
program characteristics related to the following areas: (1) size of budget; (2) target populations 
served; (3) location of services; (4) service providers; (5) instructional approaches; (6) client 
placement; (7) curriculunni/instructional focus; (8) client assessment; and (9) methods of 
evaluation. The characteristics of the three state projects selected for visitation — Connecticut, 
North Carolina, and Rhode Island — are described in Table 11- 1. 

Structured interviews with state directors and local program coordinators, conducted during 
site visits, provided information pertaining to the operation and services of the AEH program and 
ensured that the views of administrators at both the state and local levels were reflected in the 
overall study design. 

Survey Prc*Tcsts 

Following the preparation of preliminary drafts of the two surveys, each was pre-tested 
through telephone interviews with several randomlj^^selected state and local administrators. These 
interviews were useful in clarifying ambiguous questions, ensuring the completeness of closed- 
ended responses, and identifying any additional areas of concern that had not been previously 
addressed. 
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TABLE n-1 

CHARACTERISTICS OF STATE PROJECTS VISITED 



















Budgets 


$153,000 


$492,107 


$199,423 


Target Popubtions 


Substance abusers; mentally 
ill 


Substance abusers; victims 
of partner abuse; 
developmentally disabled; 
adults waiting for subsidized 
housing" 


Snreet youth; dislocated or 
disabled workers; mentally 
ill; victims of parmer abuse; 
substance abusers 


Service Delivery 
Sites 


Shelters; adult learning 
centers; transitional housing; 
soup kitchen, alcohol 
rehabilitation agency; service 
agencies for mental patients 


Shelters 


Shelters; homeless service 
agencies 


Service Providers 


*-EA; CBO; shelter 


Conmiunity colleges 


Shelters; literacy 
organization; CBO 


IMstinctive 

Instmctioiud 

Approaciies 


Small Group Instruction; 
Computer Assisted 
Instruction; Connecticut Adult 
Performance Program 
(CAPP) 


Computer Assisted 
Instruction (PLATO software) 


Intergenerational; whole 
language approach; learner 
contracts; process writing 


Client Pimcement 


CAPP 


CASAS; TABE; WRAT; 
SORT 


TABE; LVA Read Test; 
recommendations by shelter 
staff or case managers 


Canicoluin/ 
Instructional Focns 


ABE; GED; ESL; Ufe Sidlls; 
CAPP 


ABE; Life Skills TLife Skills 
fhr the Hornless** and ^'The 
Twelve Step Curriculum/* 
both developed in Nonh 
Carolina) 


ABE; GED; Life Skills 


Client Progress 
Assessment 


CAPP; CASAS 


TABE; entrance/exit 
interviews 


TABE 


Evaluation 


SEA conducts evaluation 
based on: local project 
reports; site visits; student/ 
staff opinions; and progress 
toward state goals 


Independent evaluator 
conducts evaluation based on: 
student/staff opinions and 
progress toward state goals 


Independent evaluator 
conducts evaluation based 
on: demographics; student 
progress; and exit data 



Review of Draft Surveys 

The final step in the development of the surveys consisted of an internal review by the 
Office of Policy and Planning and the Office of Vocational and Adult Education of the U.S. 
Department of Education and an external review by the Office of Management and Budget. 
Reviewers* comments were incorporated in a final version of the two surveys. 
Survey Design 

The state and local surveys are presented in Appendix B. Here, the content and design of 
each survey is described briefly. 
State Project Survey 

The State Project Survey is designed to collect information relevant to the operation of the 
AEH program at the state level (see Appendix B). This survey consists of five sections: (1) an 
overview, containing questions about the objectives of AEH projects, pre-existing programs, the 
duration of projects, the coordination of services at the state level, and challenges to the 
implementation and development of state projects; (2) a section on state project administration, 
designed to elicit information concerning the organization of state projects, administrative staff 
qualifications, and the institutional arrangements that exist between state projects and local 
programs; (3) a section on project finance, which deals with supplementary funding sources and 
budget allocations; (4) a section cn staff and curriculum development, including questions 
pertaining to state-mandated requirements for local staff, state-supported staff development, and 
state-level curriculum development activities; and (5) a section on monitoring and evaluation, 
designed to collect information about the monitoring of local programs and the role that states 
play in evaluating program effectiveness. 
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Local Program Survey 

The Local Program Survey consists of three separate components, or "instruments " 
designed to collect information at the program, site, and participant levels (see Appendix B). A 
description of each instrument follows: 

• Local Program Survey: Program Data — The Program Data instrument is designed 
to provide an overall description of local programs and to obtain local coordinators* 
views regarding the most elective means of providing educational services to the 
homeless. In particular, this instrument elicits information about local program 
funding, costs, staffing, support services, outreach, and tracking of participants. 

• Local Program Survey: Site Data — The Site Data instrument is designed to collect 
information on a site-specific basis pertaining to the location and accessibility of 
services, instructional approaches, curricula, and staff qualifications. Several items are 
addressed to local program coordinators, while others are addressed to the principal 
instructors at each site. 

« Local Program Survey: Client Data — The Client Data instrument is designed to 
collect information regarding client characteristics, the services that they receive, and 
their accomplishments. Data from program records are collected retrospectively for all 
clients who enrolled in the AEH program during the month of June 1992 and pertain 
to the three-month period following each client's enrollment. 

Data Collection 

Data were collected in the fall and winter of 1992. In September, state directors were 
asked to provide information about each of the local programs in their state, including the number 
of sites served by each program and the number of clients who enrolled in each program in June 
of that year. Based on this information, survey packages were assembled for each state and 
mailed in December 1992. State project adnunistrators served as intermediaries in the data 
collection process, forwarding surveys to local programs and returning completed surveys for 
processing. 

This procedure resulted in an exceptionally high rate of participation. Thirty-two of the 35 
states funded in 1992 participated in the State Project Survey, and 31 states participated, to 
varying degrees, in the Local Program Survey (see Figure II- 1). Because Tennessee had ceased 
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FIGURE 11-1 



STATES PARTICIPATING IN STATE PROJECT AND 
LOCAL PROGRAM SURVEYS 
(By Adult Education Area) 




Area 1 




I n 



mm 



Level of Participation 



StatM participating In both tlHi BtmXm Project and Local 
Program 8urv«ys 

StatM participating only In Xhm Local Program Survey 



StatM participating only In Xhm BXmXm Project Survey 

StatM participating In n^lthar Xhm BXmXm Project nor Local 
Program 8urv«ya 

StatM not r«c«lvlng AEH funds during 1992 
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operations prior to December of 1992, it was excluded from the study. Four other states — 
Delaware, Michigan, New Hampshire, and Oklahoma — were near the end of their funding cycles 
at the time the surveys were mailed. Of these states, Michigan elected not to participate in the 
study, while the remaining three participated on a limited basis. 

Table II-2 presents the return rates for the three instruments comprising the Local Program 
Survey. Overall, about 93 percent of Program Data instruments, 81 percent of Site Data 
instruments, and 77 percent of Client Data instruments were returned. Only five states — 
Alabama, Delaware, Nevada, Texas, and Wisconsin — fell below a 50 percent return rate for any 
of the three Local Program Survey instruments, and most states achieved return rates that were 
substantially higher, often in excess of 90 percent. 

Literac'" Assessment 
As a supplement to the state and local surveys, an assessment of the range of literacy 
skills of AEH participants w^s conducted in the fall of 1992. New enroUees at randomly selected 
programs across the United States were tested to obtain baseline data on the proficiencies of AEH 
clients prior to their participation in the program. Test selection criteria and sampling procedures 
are described below. 
Test Selection 

Based on an evaluation of several commercially available tests, the Document Literacy 
Test, one of the three ETS Tests of Applied Literacy Skills (TALS), was selected for use in the 
literacy assessment. The TALS instrument was evaluated on the basis of several criteria, 
including time requirements, iczl format, the relevant range of achievement, comparability, 




TABLE n.2 
Local Program Survey Returns 



1 — ^ 

.:J 

Slite 1 


4rf Local 


\ 1 
:SiirT4gft R«tanicd | 




Rftetwd 1 


1 'NuBdicr 
■ a«ne ■ 


Local Prognun: 
Rctumed 












Ferccot 


1M2:.: ^ 
'JEflroOcM}:: 


Ntunber 


Perceiit 


1 ^ 1 


19 


xo 


QJ.7 1 


46 




0^ ^ 1 


295 


m/ 


^O Q 


AZ 


6 


A 

v 


1 


23 


77 




109 


iVf 


Ofi 0 


AR 


10 


in 


innn 1 


26 






157 




01 A 


CA 


12 


in 

Xv 




24 




KA 9 


347 


loU 


31. y 


CO 1 


1 ^ 


fi 
\} 


innn 
xuu.u 


10 


XII 




54 




1/Vi A 

lUO.O 


CT 1 


1 ^ 




innn 
xuu.u 


8 


fi 


1 AA A 


28 


2o 


1 AA A 
100.0 


DE 1 


2 




innn 

XUU.V 


7 


7 


xuu.u 


19 


c 

3 


OA *1 


FL 


7 


7 




43 


7fi 




220 


1 AO 

ioy 


'Ta q 
/O.o 


HI 


2 


*• 


i(inn 

xw.v 1 




7 


inno 


0 


A 




IL 


4 


4 


1000 1 

XW.v 1 




7 


77 fi 


25 


9n 


fiA n 

oU.U 


IN 


8 


fi 

o 


1000 


26 




fift ^ 


122 


1 99 


1 AA A 

iUU.O 


KS 


7 


7 


1000 


33 


xy 


^7 


205 


l^fi 
X3o 


/ /.i 


ME 


7 


7 


1000 

XW*v 


38 




QJ.7 

TH. / 


31 


^1 


xuu.u 


MD 


8 


fi 

o 


1000 


28 


*»*♦ 


fi^ 7 


142 


l^fi 
X JO 


0*7 9 

y /.z 


1 ^ 




10 

XV 


900 


24 


9^ 


0^ fi 


99 


00 


1 AA A 


1 ^ 


4 


4 


1000 


6 


A 


1000 


5 


c 

3 


1 AA A 

xuu.u 


MO 


8 


fi 

o 


1000 


33 


^1 
JX 




75 


/4 


OQ n 


MT 


4 


D 




6 


A 
*r 


00./ 


28 


Z3 


OO 1 

62.1 


NE 


2 






9 


0 


AA *7 
00./ 


37 


51 


xOO.O 


NV 


3 


7 


OO./ 


13 


0 


AO 0 


84 


35 


41.7 


NY 


24 


21 


873 


69 


42 




291 


ISM 
Xo4 


o^.z 


NC 


14 


14 


100.0 


1 40 


39 


97.5 


332 


321 


96.7 


ND 


4 


4 


100.0 


1 10 


10 


100.0 


14 


14 


100.0 


OH 


12 


12 


100.0 


1 50 


48 


96.0- 


175 


144 


82.3 


RI 


5 


5 


100.0 




9 


100.0 


VI 


61 


100.0 


TX 


18 


11 


61.1 


1 ^2 


30 


48.4 


434 


284 


65.4 


UT 


3 


3 


100.0 


1 1^ 


.12 


85.7 


130 


121 


93.1 


VT 


7 


6 


85.7 


8 


6 


75.0 


15 


14 


93.3 


WA 


8 


8 


100.0 


28 


26 


92.8 


142 


136 


95.8 


WV 


13 


13 


100.0 


15 


14 


93.3 


55 


55 


100.0 


WI 


4 


3 


75.0 


10 


9 


90.0 


101 


34 


33.7 


TOTAL 


248 


230 


92.7 


729 




W.7 


3,832 


2,943 


76.S 



25 44 



reliability, and other psychometric properties. As shown in Table the test takes only 40 
minutes to complete, employs a constructed response format that may be less threatening to AEH 
clients, and discriminates well at the higher range of achievement. Equally in^rtant, this 
instrument employs the same underlying framework as several recent assessments of statistically 
representative samples of adults — e^g,, NAEP's Young Adult Survey, the Department of Labor's 
Workplace Literacy Assessment, and the Department of Education's National Adult Literacy 
Survey — thus permitting cross-study comparisons. 

The Document Literacy Test, a brief information form used to describe each new enroUee, 
and instructions for administering the test are presented in Appendix C. 



TABLE n.3 

DESCRIPTION OF TBOE TALS DOCUMENT LITERACY TEST 







Time Requirement 


40 minutes 


Test Format 


Single/constructed response 


Appropriateness for AEH Client 
Fopulation 


Items involve actual adult context materials 


Relevant Range of Achievement 


Adult grades 4-post-secondary achievement 


Comparability to Statistically 
Representative Samples 


TALS shares same framework underlying NAEP's 
Young Adult Suivey, the Department of Labor's 
Workplace Literacy Assessment, and the Department 
of Education's National Adult Literacy Survey 


Reliability 


Alpha = .92 (form A)A89 (form B) 


Other Psychometric Properties 


Inter-rater reliabiUty for scoring open-ended 
responses is .95 



Data Source: Kinch, JungcMut, mi Campbell, 1991 
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Sampling Procedure 

Employing a stratified sampling procedure* a representative sample of thirty local 
programs was selected for participation in the literacy assessment. Local programs were divided, 
first» into three equal strata, based on an estimate of the number of participants served each 
month, then, into four strata, based on the adult education area in which each program is located.' 
Local programs were selected, with probability proportionate to size, from each of the 12 resulting 
cells to achieve a sample size of 30. Of the 30 programs selected, all but three participated in the 
assessment (see Figure II-2). 

Within each participating program, participants enrolling between October IS and 
November 14, 1992 were selected for testing. The resulting sample consisted of 405 new 
enroUees. Of this number, the Document Literacy Test was administered to 3S9 individuals 
(88.6%) — 14 (3.5%) did not take the test because they were judged to be limited English 
proficient, and 32 (7.9%) were excused for various other reasons. 

Interpreting Results 

The interpretation that one places on each of the findings presented in this report depends, 
in part, on the source of data upon which it is based. In this regard, readers should consider two 
issues: (1) the statistical significance of reported findings and (2) the interpretation of results 
based on data derived from observations over a limited time-span. 
Statistical Significance 

With the exception of retrospective client data, the data collected through the state and 
local surveys are drawn from the universe of AEH projects, programs, and sites, and, therefore, do 



^The number of new enrollees in June 1992 was used as an estimate of the number of 
participants served each month. 
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FIGURE 11-2 



LOCAL PROGRAMS SELECTED FOR LITERACY ASSESSMENT: 
PARTICIPATING AND NON-PARTICIPATING PROGRAMS 

(By Adult Education Area) 
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local program In QIandlva, MT partlclpatad, but complatad taat raporta waia ioat in tha mall. Tha 
local program In Enid, OK raportad no naw anrollaaa during tha ona*month taat admlnlatratlon parlod. 
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not require the application of statistical significance tests. Retrospective client data — collected 
through the Local Program Survey: Client Data instrument — may be viewed either as the 
universe of new enroUces in June 1992 or as a representative sample of all enroUees in 1992.^ 
While the former interpretation does not require that findings be subjected to tests of significance, 
the latter does. However, because the sample of new enrollees is so large — approximately 3,000 
cases — nearly any substantively significant finding will also be statistically significant. 
Therefore, in reporting results, we have indicated statistical significance levels only in those 
instances where findings are based on a small subsample of tiie larger sample of enrollees. 
Finally, statistical significance levels are reported for all findings based on the literacy assessment 
component of this study, as these data constitute a representative sample of new enrollees drawn 
from 30 randomly selected local programs* 
Interpreting Program Outcome Data 

Findings pertaining to program outcomes are based on data derived from observations for 
a three-month reporting period (Local Program Survey: Client Data instrument) and, as such, 
represent conservative estimates. While approximately two-thirds (64.9%) of participants leave 
the program within three months, any outcomes accruing to the remaining one-third (35.1%) after 
that period are not reflected in these data. Thus, outcomes reported in this study marginally 
underestimate the outcomes that would have been observed had we been able to extend the 
reporting period beyond three months. The reader should bear this in mind in interpreting 
findings presented in Chapter VII. 




^ There is no evidence of seasonal bias, nor is the number of new enrollees in June 1992 
unusually low or high — the 3,832 enrollees in tiiat month represent approximately one-twelfth of 
1992 enrollments. 
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CHAPTER m 

ORGANIZATION AND STRUCTURE OF THE AEH PROGRAM 



Overview 

Prior to the establishment of the Adult Education for the Homeless (AEH) Program, in 
1987, only one state provided educational services for homeless adults through a program 
administered at the state level. Locally, most programs funded through AEH (55*2%) had either 
not existed or had not provided educational services specifically targeting the homeless. 

Over the past five years, the AEH program has expanded services significantly. In its first 
year of operation, the program served only 18,000 homeless adults nationwide. However, by 
1992, AEH provided services to nearly 50,000 clients, or approximately 1 in every 10 homeless 
adults in the United States.^ These figures are all the more impressive when one considers that 
AEH appropriations have not kept pace with the rising demand for educational services. Between 
1987 and 1992, appropriations increased by only 42 percent, while, during that same period, 
services nearly tripled! 

In 1992, AEH funded projects in 35 states, which, in turn, supported some 282 local 
programs* On average, each of these programs served about 180 clients. Although a few larger 
programs — comprising about 7 percent of the total number — provided services to more than 
500 individuals, the majority (50*7%) served no more than 100 clients (sec Figure 10*1). 



■ ^ The number of clients served in 1992 is estimated by extrapolating from the 227 local 
V programs for which data are available to all 282 programs providing services during that year. 

This computation assumes that the number of participants in the 55 programs for which data are 

■ missing served approximately the same number of clients as those for which data are available* 
9 (Because Tennessee was funded for only six months, one-half of the estimated number of 

participants in that state*s 11 programs are included in the total*) The actual estimate of the 
|t number of clients served in 1992 is 49,665 or about one-tenth of the 500,000 to 600,000 homeless 

' Americans estimated by Burt and Cohen (1989). 
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FIGURE HM 

Distribution of Number of Clionts 
Sarvod by Local Programs (1992 Program Year) 
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< SO 51*100 101*150 151*200 201-300 301-500 > 500 
NukTibsr of Clisms in Program Year 

Data Source: Local Program Survey: Program Data (Top SecUont page 2). 
Number of Cases: 227 valid r^ases; 3 missing cases. 



Each local AEH program administers the delivery of services at one or more sites — e.g., 
emergency shelters, transitional housing, drug rehabilitation centers, community colleges, 
churches, libraries, and other locations. In 1992, services were provided at 776 sites, and each 
site served an average of 70 clients. Although roughly 15 percent of these sites offered services 
to more than 100 clients, about one in four enrolled 20 or fewer individuals, and about one-half 
(49.2%) served no more than 40 (see Figure III-2). Thus, while the dimensions of the AEH 
program are impressive, educational services typically are provided on a small scale. 

This chapter examines the organization and structure of the AEH program. First, state 
project administrative functions are described and the institutional relationships that frame the 
overall structure of the AEH program are defined. Subsequent sections describe staffmg, finance, 
and evaluation procedures at both the state and local levels. Finally, the principal challenges that 
state and local administrators have faced in building the AEH program are identified and various 
approaches to overcoming these obstacles are discussed, 
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FIQURE lil-2 

Distribution of Numbor of Ciionts SorvMi by Sites 
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The Stnicture of the AEH Pro-am 
State Projects; Kev Fiinctiops 

■ Since 1989» the Federal Government has awarded funds to AEH State Projects through a 
^ discretionary process designed to provide support to those states with the most competitive 

delivery systems. State educational agencies compete for funds to enable them to implement, 

■ either directly or through contracts/subgrants, programs of "literacy training and basic skills 

^ remediation for adult homeless individuals within their State** {Federal Register, 1989). Thus, a 

key function of State Project administrators is to support local programs in their efforts to provide 
I educational services in an effective and efficient manner. 

^ States provide such support in a variety of ways (see Figure III-3). All, or nearly all, 

states provide technical assistance (100%), monitor the development of local programs (100%), 

■ and support staff development at the local level (96.9%). In addition, most states (90.6%) engage 

*0 33 51 
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in the development and dissemination of curricula designed to meet the needs of the homeless 
population. This includes the dissemination of curricula developed in other states (84.4%) and 
local programs (15.6%), support for curriculum development at the local level (56.3%), and, in 
some cases, the development of curricula at the state level (31.3%). Most states (87.5%) also 
conduct local program evaluations, either directly, through an independent evaluator, or by 
establishing criteria for local-level evaluations. Finally, due to the limited resources of the AEH 
program. State Project Directors regularly seek additional state-level funding (62.5%) and, in some 
cases, local-level funding (18.8%). In New York, for example, AEH funds are used as "seed 
money to generate additional state aid which would not otherwise be available" (New York State 
Project Survey, 1993). 
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Coordination of services has proven to be a critical elenient in the development of 
successful state projects and, therefore, represents another important function of project 
administrators. All state projects coordinate with the Adult Education Program (see Figure III-4), 
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and a majority coordinate with Homeless Children and Youth (68.8%) and JTPA (53.1%). 
Somewhat fewer states coordinate with JOBS, Even Start, and Head Start (46.9%, 34.4%, and 
25%, respectively). 

The most conmion means of coordinating services — i^;^oked by four in five states — is 
the formation of statewide advisory groups (see Figure ni-5). In Rhode Island, for example, the 
advocacy efforts of the AEH State Project Director resulted in the creation of a task force to 
formulate policy initiatives. Due largely to the State Director's involvement, 'iiteracy services 
now rank high on the list of priorities'* (Rhode Island State Project Survey, 1993). Interagency 
referral agreements, state hot lines, interagency needs assessments, and shared funding represent 
additional means of coordinati^\g services at the state level. 
Administrative Relationships 

In a majority of states (53.1%), both educational and non-educational agencies receive 
funds to deliver or to coordinate the delivery of educational services at the local level. In the 
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FIGURE lll-S 
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remaining states (46.9%), educational agencies perform this function exclusively. As shown in 
Figure III-6, most states (61.3%) distribute funds through a competitive process. However, in 
nearly one-third of the states (29.0%), local programs receive fiinds through non-competitive 
grants. Other states distribute funds through a combination of competitive and non-competitive 
grants (3.2%) or on a formula basis combined with non-competitive grants (6.5%). 

In some cases, sub-grantees act as the principal service provider at the local level, while, 
in other instances, sub-grantees serve a purely administrative function, coordinating tiie services of 
one or more providers (see Figure ni-7). Most commonly, sites are serviced by local education 
agencies (46.5%). Other key service providers include community colleges (20.4%), community 
organizations (11.2%), shelters or transitional housing (11.1%), and volunteer literacy 
organizations (4.3%). 
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FIGURE liM 
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Adminiytrfffi ve and Program Staff 
State Project Director and Support Staff 

While some AEH projects are administeitd by the State Project Director alone, in other 
cases, other professional and/or support staff assist in administrative duties. On average, projects 
employ 1.7 professionals, who commit a total of about 21 hours per week to project 
administration, and 1.3 support staff, who devote about 10 hours per week (full/part time) to 
support tasks. 

In a majority of states (62.5%), the role of Project Director is assumed by an individual 
serving in an existing position (e.g.. State Program Specialist). In other cases, however, a new 
position is created and the Project Dkector is hired to administer the project on a full-time basis. 
Often, those filling these positions have more relevant experience than do their counterparts who 
**wear more than one hat." This is supported by the data presented in Table m-l, which 
compares the number of years of experience of project admmistrators in newly funded and 
existing positions. Those in newly funded positions have more experience with the homeless, 
more adult education experience, and more experience* administering educational programs than do 
those in existing positions. However, both groups bring impressive qualifications to the job. 



TABLE m-l 
Qualifications of State AEH Project Directors 



Type of 
Experience 


AwrateNunAer of Years oTExnerUnce 


■Newly Funded : 
Position 


Existing Position 


AU 


Experience With 
Homeless 


5.5 


3.5 


4.5 


Adult Education 
ExDerience 


19.5 


13.9 


16.2 


Experience Managing 
Educational Proerams 


14.8 


13.1 


13.6 



Data Source: State Project Survey (Questions 11-13). 
Number of Cases: 32 valid cases. 
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Local Program Staff 

Local Coordinators 

Local program coordinators are typically involved in every aspect of the delivery of 
services at the local level. Indeed* in many smaller programs, the local coordinator doubles as a 
teacher or counselor. In addition to securing funding, local coordinators hire and evaluate staff, 
establish relationships with service delivery sites, and work to establish cooperative relationships 
with support service agencies. These individuals often are motivated by the highest humanitarian 
ideals. The testimony of one local coordinator in Florida captures the feelings expressed by 
many: 

This is more than a job. It is really a "'calling.** Although we give our clients 
instruction in literacy and basic skills, we also try to give them the hope and will 
to penevere . . . our classrooms are filled with hope. 

Instructional Staff and Counselors 

The teachers, instructional aides, and counselors who staff the nearly 300 local AEH 
programs throughout the United States bring an equally high degree of commitment to their jobs. 
The fact that many are volunteers — 11.9 percent of teachers, 69.9 percent of aides, and 13.8 
percent of counselors — is indicative of this. In a very real sense, local program staff constitute 
the fundamental link between the AEH program and the homeless men and women it serves. 

Due to the important role that local staff play in the delivery of services, careful attention 
is given to their selection. The single most important criterion in selecting new staff members, 
cited by three in five local coordinators, is the ability to relate to homeless clients. Staff 
screening procedures reflect the importance of this dimension. In nearly one-third of local 
programs (31.1%), prospective instructional staff members are observed in a classroom setting 
with homeless clients before they are hired or accepted as volunteers, and, in about 1 in 10 
programs (10.7%), homeless clients conduct interviews with prospective staff. 
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Most local programs (91.7%) provide preservicc and/or inscrvice training for both 
instructional staff and counselors.^ In these programs, staff receive an average of 12 hours of 
preservice training and roughly 24 hours of inscrvice training annually. Programs that provide 
preservice or inscrvice training generally emphasize student placement/assessment skills (84.S%)« 
basic skills instruction (81.2%), orientation to the homeless population (81.2%), counseling/referral 
information (73.9%), and adult learning theory (70%). More than a third (36.2%) of these local 
programs also offer instruction in teaching English as a second language. 

In nearly all programs (90.3%), local coordinators conduct regular site visits — on 
average, 14 visits per year — to monitor the performance of instructional staff and counselors. 
As shown in Figure III-8, staff effectiveness is most often evaluated in terms of the observed 
rapport between staff and clients (89.6% of programs), educational outcomes of clients (84.6%), 
and student evaluations (58.8%). In addition, a substantial percentage of local programs (33.9%) 
employ a peer review process. In some states, such as Maine, peer review is encouraged 
statewide. Through the adoption of this process, program staff have "learned to identify 
challenges and highlight successful practices" (Maine State Project Survey, 1993). 

Given the careful attention that is focused on the selection, training, and evaluation of 
local staff, it is not surprising thai average qualifications are high (see Table III-2). Nearly all 
teachers and counselors are college graduates (94.8% and 87.7%, respectively), as are a majority 
of instructional aides (52.9%). About three-fifths of teachers (59.6%) arc certified in elementary/ 
secondary education, about one-third (31.9%) arc certified in adult education, and more than one- 
third (36.7%) of counselors hold state certification. Finally, all staff categories have considerable 



^ Nearly all states (97%) promote staff development at the local level. Staff development 
activities include general adult education training (90%), adult education training for homeless 
adults (80%), as well as attendance at national conferences (76.7%) and state-sponsored 
conferences (63.3%). In many states (43.3%), support for external consultants is also provided. 
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experience working with the homeless — an average of 4.3 years, 2.7 years, and 1.6 years for 
counselors, teachers, and aides, respectively. 



State Prelect and Local Program Finance 

State Project Finance 
FiMiding 

In 1992, state projects received some $9.8 niillion in AEH fiinds^ to support educational 
programs for homeless adults at the local level. Grants ranged in size from $101,239 to $600,000, 
averaging approximately $285,176. 



^ This figure includes $196,397 awarded to Tennessee. However, Tennessee ceased operation 
after only six months. 
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TABLE m-2 
Local Program Staff Qualificatioiis 




Average Number of Years Post- 
Secondary Education 



Percent With College Degree 



94.8 
(713) 



52.9 
(344) 



87.7 
(195) 



Percent With Elementary/Secondary 
Certification 



59.6 
(673) 



13.0 
(324) 



NA 



Percent State-Certified Counselor 



NA 



NA 



36.7 
(185) 



Percent With Adult Education 
Certification 



31.9 
(649) 



5.1 
(315) 



11.5 
(165) 



Average Number of Years of Adult 
Education Experience 



5.7 
(685) 



2.2 
(344) 



NA 



Average Number of Years of Adult 
Education Counseling Experience 



NA 



NA 



5.7 
(182) 



Averajje Number of Years Experience 
With Homeless 



2.7 
(691) 



1.6 
(350) 



4.3 
(190) 



Data Source: Local Program Survey: Program Data (Question IS). 

Number of Cases: Data are derived from 230 Programs. Number of cases for each cell are 
presented in parentheses. 



In some cases, states supplemented Federal grant money with funds from other sources. 
Table in-3 displays the percentage of state projects that received non-AEH funding and, for those 
receiving such funding, the average amount of support received. About 1 in 3 AEH projects 
(34.4%) received supplementary Adult Education Act funds (averaging $208,634), and another 1 
in 10 projects (9.4%) received supplementary state funds (averaging $179,200). Other sources of 
non-AEH funding included JTPA, JOBS, and Even Start. 
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TABLE ni-3 



Percentage of State Projects Receiving Non-AEH Funding 
and Average Amount of Funding 




JTPA 



JOB? 



3,1 



25,000 



Even Start 



3.1 



25,000 



State Funding 



9.4 



179,200 



' Average amount of funding for State Projects receiving funds from the identified 

source. 

Data Source: State Project Survey (Question 21). 
Number of Cases: 32 valid cases. 

Expenditares 

Table in-4 presents the percentage breakdown of total project expenditures for 1992. 
State-level administrative costs accounted for some 12.9 percent of total expenditures — 7.9 
percent for administrative staff salaries, 2.6 percent for administrative indirect costs, and less than 
1 percent each for monitoring travel, evaluation, and miscellaneous administrative costs. Program 
costs accounted for the bulk of state-level expenditures (86.9%), nearly all of which was passed 
on to local programs (83.8%). One percent or less was allocated to staff development, program 
materials and supplies, curriculum/assessment development costs, technical assistance, and other 
state program costs. 
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TABLE m-A 

State Project Expenditures 
(1992 Project Year) 











j Administrative Staff Salaries 


7.9 


Administrative Indirect Costs 


2.6 


Monitoring Travel Expenses 


0.9 


Evaluation Costs 


0.8 


Other Admimstrative Costs 


0.7 






Funding Passed on to Local Programs 


83.8 


Staff Development 


1.0 


Program Materials and Supplies 


0.7 


Curriculum/Assessment Development Costs 


0.6 


Technical Assistance 


0.6 


Other Program Costs 


0.2 







Data Source: State Project Survey (Question 20). 
Number of Cases: 32 valid cases. 

Note: Total costs do not sum to 100% due to rounding error. 



States varied markedly in terms of the proportion of total budget allocated to state 
administrative costs, ranging from a low of 1.7 percent to a high of 31.5 percent. A variety of 
factors may account for the observed differences in administrative costs: (1) since all states share 
certain fixed costs, smaller projects may incur disproportionately higher administrative costs than 
larger projects; (2) due to costs associated with implementation, projects in existence for shorter 
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periods of time may require higher administrative expenditures than those in existence for longer 
periods; and (3) projects headed by newly funded (full-time) directors may incur greater 
administrative costs — due to differences in compensation — than projects headed by directors 
occupying existing positions. These factors are investigated in Figure 1II-9. The data most 
strongly support the latter of the three explanations suggested above. Projects headed by newly 
funded administrators incur administrative costs representing almost 18 percent of total budget, on 
average, while projects run by administrators serving in existing positions incur administrative 



costs averaging only 1 1 percent of total expenditures. Program size is unrelated to administrative 
costs differences, and duration of program bears only a small relationship, albeit in the expected 
direction. 
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Local Program Financ e 
Funding 

In 1992, local AEH programs received state grants ranging in size from $300 to $300,000 
(in one instance) — averaging some $31,327 — in support of educational programs for the 
homeless at the local level. In addition, approximately 44 percent of local programs received 
supplementary funds from non-AEH sources, averaging some $30,069. Many programs also 
benefited from in*kind support, especially in the form of volunteer services and donations of space 
and materials. 

Expenditures 

Table III-5 displays the percentage breakdown of local program expenditures for 1992. 
Administrative costs accounted for some 17.9 percent of total expenditures at the local level — 
14.1 percent for administrative staff salaries, 1.6 percent for local indirect costs, and about 2 
percent for all other administrative costs combined. Program costs accounted for approximately 
82 percent of local expenditures, consisting primarily of instructional staff salaries (65.6%) and 
materials and supplies (6.9%). Expenditures for child care, transportation, and staff development 
each accounted for less than 2 percent, and expenditures for the rental of instructional space, 
technical assistance, and curriculum/assessment development accounted for less than 1 percent 
each. An additional 2.8 percent was allocated to miscellaneous program costs. 

In most cases (58.7%), administrative costs represented less than 10 percent of local 
program expenditures. However, in about 1 in 10 programs (11.6%), administrative costs 
accounted for more than one-half of total expenditures. Typically, in tiiese programs, instructional 
staff salaries were paid by local education agencies, and AEH funds were used exclusively to 
compensate local coordinators. 
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TABLE m-S 

Allocation of AEH Program Funds 
(1992 Program Year) 





Administrative Staff Salaries 


14.1 


Local Indirect Costs 


1.6 


Monitoring Travel Expenses 


0.5 


Administrative Materials and Supplies 


0.4 


Rental Cost of Administrative Office 


0.2 


Evaluation Costs 


0.0 


^ Other Adi mistrative Costs 


1.0 






Instructional Staff Salaries 


65.6 


Instructional Materials and Supplies 


6.9 


Child Care 


1.9 


Transportation 


1.6 


Staff Development 


1.6 


Rental Cost of Instructional Space 


0,7 


Technical Assistance 


0.5 


Curriculum/Assessment Development Costs 


0.4 


Other Program Costs 


2.8 







Data Source: Local Program Survey: Program Dau (Question 13). 

Number of Cases: 225 valid cases; S missing cases. 

Note: Total costs do not sum to 100% due to rounding error. 
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Monitoring and Evaluation 

All states participating in the AEH program monitor the performance of sub-grantees 
within their state on a regular basis. Site visits are conducted, on average, two to three times per 
year, and local program reports are reviewed annually. In addition to regular monitoring, all 
states conduct annual program evaluations (see Figure m-lO).^ While many states subcontract 
this task to an independent evaluator (40.6%), about one-third (34.4%) conduct evaluations 
directly. Other states establish criteria for evaluations that are conducted at the local level (9.4%) 
or employ some combination of direct and local-level evaluations (12.5%). In Indiana, for 
example, evaluations are conducted by the states, but '"within the context of local objectives'* 
(Indiana State Project Survey, 1992). 
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Figure m-ll displays the various criteria employed by states to evaluate the success of 
local programs. By a significant margin, participant outcomes represent the leading measure of 
program effectiveness adopted by state evaluators (96.8%). In addition, about three in four 
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^ Vermont is currently in the process of implementing local program evaluation procedures. 
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examine the evaluations of instructors, local coordinators, and participants (77.4%, 77.4%, and 
74.2%, respectively) and about one-half (48.4%) consider the evaluations of support service 
agencies. 
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Participant outcomes used to evaluate the effectiveness of local programs are displayed in 
Figure III-12. The number of program participants passing or making progress toward the GED is 
employed as a measure of success in all but one state. Other participant outcomes commonly 
used in evaluating program effectiveness include the number of participants placed in other 
training/educational programs (90%), the number completing or making progress in Level I 
(833%), and the number obtaining or improving employment (80%). Those participant outcomes 
that are least conmionly used in assessing program effectiveness include social/psychological 
gains (633%), standardized achievement gains (633%), average number of contact hours (60%), 
competency-based achievement gains (60%), and number of participants obtaining housing 
(533%). 
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FIGURE ilkl2 



Participant Outcomes Considered in the Evaluation 
of Local Programs 
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Status 
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Number Obtaining Housing 
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Data Source: State Project Sun^ey (Question 35) 

Number of Cases: 30 valid cases; 1 missing case; 1 case conducting no local program evaluations 
excluded. 

Note: Five states consider other participant outcomes in evaluating local programs, including clients' 
ability to demonstrate improved thinking and communicatton skills, citizenship activities, and the utilization 
of other agencies. 
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Challenges to Development and Implementation 

Stotc Level 

State and local administrators face a variety of challenges in building successful programs. 
Figure UI-13 presents several of the principal challenges encountered at the state level, for all 
projects combined and» separately, for newer and older projects. Uncertainty regarding Federal 
funding ranks first among the concerns of state project administrators. Nearly 9 in 10 (87.1%) 
cited this as one of the three most important challenges that they face. A recent shift from one- to 
ttiree-year funding cycles should alleviate administrators' concerns in this area substantially. 

Inadequacy of funding and delays in funding were also cited as major concerns at the state 
level (61.3% and 54.8%, respectively).^ In this regard, the Director of New York's AEH project 
was emphatic, reporting a "severe lack of adequate funding" in his state. Funding deficiencies in 
New York and many other states have been at least partially overcome ''by funding 
comprehensive educational centers that blend McKinney funds with other Federal, state, and local 
re-sources" (New York State Project Survey, 1992). 

The low priority of educational services among agencies working with the homeless was a 
concern of nearly one-half of project administrators (48.4%), especially those administering 
projects in existence for more than two years (62.5%). In New Hampshire, the relatively low 
priority of education in some shelters was effectively addressed "by patiently and continually 
negotiating for educational time for shelter residents" (New Hampshire State Project Survey, 
1992). 



^ In the earliest stages of program development, a stable infusion of funds is especially 
critical. Consequently, administrators of newer projects — those in existence for less than two 
years — were particularly concerned about the inadequacy of and delays in Federal funding 
(73.3% in each case). 
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Project administrators expressed a desire for increased technical assistance from the U.S. 
Department of Education in several areas (see Figure III- 14). Chief among these was the desire 
for more information about other AEH projects and, especially, models of curriculum and 
assessment (expressed by 83.9% of project administrators). Given that allocations for curriculum 
and assc sment development comprise just one-half of one percent (0.6%) of total project 
expenditures, the need for assistance in this area would seem to be especially great. Three in five 
project administrators (58.1%) also expressed a desire for evaluation guidelines and for specific 
training in providing educational services to homeless clients. Finally, several cited the need for 
standardized reporting forms (32.3%) and clearer proposal guidelines (22.6%). Not surprisingly, 
administrators of newer projects — with less experience in traversing what one called ''the 
bureaucratic maze'* — were more likely to express a desire for the latter (40%), 
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Local Progrgm Level 

Local program administrators face a somewhat different set of challenges (see Figure 
m-lS). Nearly two-thirds (66.5%) cited the transient nature of homeless clients as one of the 
three greatest obstacles to program development and implementation. As one local coordinator 
observed, "it is difficult to retain students when the shelter population changes daily** (Bridgeport, 
Connecticut Local Program Survey, 1992). In North Carolina, program administrators addressed 
this problem by introducing "instructor-student learning contracts** for each class session. This 
has had the effect of increasing the focus on students* specific needs at each class they attend. A 
program in Alabama has dealt with the issue of client transience in an equally innovative manner. 
There, individualized self-help packets have been developed so that clients have "major resources 
at their fingertips,** even if they should drop out early (Anniston, Alabama Local Program Survey, 
1992). 
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FIGURE IIM5 
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Data Source: Local Program Survey: Program Data (Question 3). 

Number of Cases: 224 valid cases; 1 missing; 5 cases citing no major challenges to program 
implementation or development excluded. 

Note: Approximately 18 percent of local programs cited other challenges to the development and 
Implementation of AEH local programs, including lack of cooperation of support service providers, lack 
of appropriate cunicula, lack of qualified Instructors, Federal-level funding requirements, and state-level 
funding/program requirements. 



Another major concern at the local level — expressed by nearly one-half (48.7%) of local 
coordinators — is the low priority. of literacy in the lives of homeless clients. The local 
coordinators of a West Virginia program expressed her frustration in this way: 'The people I 
work with generally see just one day at a time ... the rewards and encouragement I can give just 
aren't enough" (Parkersburg, West Virginia Local Program Survey, 1992). A program in 
Jefferson City, Missouri reported some success in addressing this problem by beginning each class 
session with training in life skills — which clients fmd especially relevant — and subsequently 
progressing to more specific instruction in literacy and basic skills. 

Other major obstacles cited by local administrators include low self-esteem among clients 
(35.3%), lack of commitment of clients (26.3%), and substance abuse (24.6%). Somewhat fewer 
cited such concerns as shelter time limitations (18.8%), inadequate funding (16.5%), lack of child 
care (14.7%), and transportation deficiencies (11.6%), and fewer still complained of inadequate 
instructional facilities (7.1%) or the uncooperative housing operators. Thus, it seems clear that the 
most critical challenges at the local level are those relating to the specific nature of homeless 
clients and the desperate circumstances in which they find themselves. 
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CHAPTER IV 
ACCESSIBILITY OF SERVICES 

Overview 

The effectiveness of any educational program is, to a large degree, a function of its ability 
to reach the population that it is designed to serve. However, in the case of programs serving the 
homeless, ''accessibility'' implies more than simply providing services at delivery sites that are 
optimally located. If, due to a sense of personal failure and diminished self-worth, clients are 
reluctant to avail themselves of services, even the most ideally located programs may fail to 
attract participants. Under these circumstances, a pro-acdve outreach effort, combined with 
incentives for participation, may be required to reach potential clients. In some cases, it may even 
be necessary to link the provision of some other essential service (e.g., housing) to program 
participation, making one contingent upon the other. Homelessness often creates additional 
barriers that can severely limit, or even preclude, program participation. Pressing personal needs 
— for health care, counseling, transportation, child care, etc. — must generally be met before 
educational services can be effectively addressed. The extent to which programs meet these needs 
represents still another important dimension of accessibility. 

The present chapter examines the accessibility of services provided through the Adult 
Education for the Homeless Program, employing a definition of accessibility that encompasses 
each of these dimensions. First, the location of services is described, focusing on geographic 
distribution and on the perceived effectiveness of ''residential** and ''non*residentiar* sites. 
Ser 3nd, outreach methods, incentives for participation, and '"required" versus ''voluntary** program 
structures are examined. Finally, the availability and utilization of support services — i.e., 
transportation, child carr, counseling, etc. — are investigated. 




Location of Services 

Commmiity Size 

The Adult Education for the Homeless Program provides services in communities of every 
size throughout the United States (see Figure IV- 1). A substantial proportion of local programs 
— about 14 percent — are located in the nation's largest cities, those witfi populations in excess 
of 1,000,0(X). Another one in five programs (19%) are located in medium-size cities (with 
populations of 250,001-1,000,000), approximately one-quarter (26.9%) are found in less populous 
urban areas (with populations of 50,001-250,000), and about two in five (40.5%) are located in 
small towns and rural areas (with populations of no more than 50,000). These figures not only 
attest to the wide availability of AEH services, but also underscore the fact that homelessness — 
contrary to popular belief — is not the exclusive problem of America's largest cities. 



FIGURE IV-1 

Distribution of Local Programs by 
Community SIzs 
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Description of Sites 

Nop>Residential Sites 

Each local AEH program provides educational services to homeless adults at one or more 
service delivery sites. More than one^-quarter (28.6%) of these sites are non*residentiaI — that is, 
sites at which clients do not obtain temporary shelter (see Figure IV-2). The most common non- 
residential locations include adult learning centers (7.3%), Salvation Army and community centers 
(6.4%), homeless day centers and soup kitchens (5.4%), and school classrooms, libraries, and 
churches (4.3%). Less conunon locations — comprising S.2 percent of all sites — include 
drug/alcohol rehabilitation centers, private homes, government buildings, mental health facilities, 
shopping nudls, and in one case, a mobile "literacy van."' 
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Residential Sites 

More typically, AEH pr -axns provide services at locations wiiere iiomeless people seelc 
temporary stielter. Such resi; jal locations make up about 71 percent of all service delivery 
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sites. For the most part, these locations consist of emergency shelters and transitional housing — 
about 42 and 26 percent of all sites, respectively. However, other locations — even jails — are 
represented (3.6%) as well. On average, approximately 45 percent of the residents at these sites 
receive AEH services and, conversely, about 81 percent of program participants at these locations 
reside on-site. Overall, nearly three-quarters (73,8%) of those served by the AEH program enroll 
at a residential location and reside there temporarily. 

More than one-third of residential sites (37.3%) impose no specific maximum stay 
limitations (see Figure IV-3). Nearly one-quarter (24.3%) impose a one-month maximum stay, 
another quarter (25.7%) restrict stays to between one and three months, and about 1 in 10 (12.7%) 
permits residents to remain for longer than three months. 



RGURE IV-3 

Drstributlon of Maximum Numbar c»f Consacuttva 
Niohto Pamitttad at Raaldantlai Sitaa 




^30 



31-90 91-180 181-365 >365 
Maximum Numbar of Nights 



Dat«Souro»: Local Program Survay: SIto Data (QuMtkMi 5) 

Numbar of Caaaa: 408 vaHd oaaas; 13 mlsalno oaiai; 167 non-rasldantlal 



No 
Daslqnatad 

Maximum 



axdudad. 



In some cases (40.4%), residential sites permit longer than normal stays for residents 
participating in tlie AEH program. Some sites permit extended stays of up to one month (16.8%), 
others permit an additional one to three months residence (28.7%), and still others allow program 
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participants to remain for more than three months (13.9%). About two in five sites (40.6%) with 
extended stay policies allow program participants to reside on-site until program completion. 

In addition to the practice of permitting extended stays for AEH ciientv, the vast majority 
of lesidential sites (85.4%) allow clients to continue in the AEH program after discontinuing 
residence. Unfortunately, in one-half of the sites that permit continued participation, less than 10 
percent of clients avail themselves of this opportunity. 
Location and Progra m Kffegrivgnftgg 

Whether educational services are more effectively provided at residential or non-residential 
locations has been a subject of considetable debate among administrators of the AEH program. 
Some contend that residential sites are more accessible, allow providers to address client needs in 
a more systematic manner, and result in higher rates of participation. Others argue that the 
constant turnover at many of these sites presents an obstacle to the effective delivery of 
educational services and suggest tfiat non-residential sites offer an atmosphere more conducive to 
learning. 

In part, this difference of opinion reflects the actual experience of individual administrators 
(see Figure IV-4). About one-half administer programs that serve both residential and non- 
residential sites, ^proximately 38 percent head programs serving only residential sites, and 
roughly 12 percent administer programs that serve non-residential sites exclusively. When asked 
to rate the educational effectiveness of residential and non-residential settings, administrators of 
programs that served only residential sites rated these locations more effective than non-residential 
settings by a wide margin — 81.3 percent versus 2.S percent. By a similarly wide margin — 68 
percent versus 4 percent — administrators of programs serving only non-residential sites rates 
these settings most effective. By comparison, administrators of programs serving both types of 
sites rated residential settings more effective than non-residential settings by nearly a two-to-one 
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margin — 37.4 percent versus 19«6 percent* Given their direct comparative experience, the 
judgments of these administrators are likely to be more objectively based. However, these data 
aloi ? are inconclusive. In Chapter Vn, this ii^sue is investigated further, focusing on the actual 
outcomes associated with each type of delivery site. 
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Beyond their overall assessments* administrators of programs providing services at both 
residential and non-residential sites identified several important advantages of residential settings 
(see Figure IV-5), These include a more comprehensive system of support (77,1%)» better 
accessibility (72.5%), greater client participation (59.6%), greater insight into clients* lives 
(54.1%), and a greater likelihood that clients will share conmior problems (50.5%). These same 
administrators also pointed to several key advantages of non-residential settings (see Figure IV-6), 
including a greater focus on education (61.1%), reduced "stigma"' due to participation in a 
program for the homeless (61.1%), better instructional facilities (48.1%), greater diversity of 
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FIGURE IV4I 

Principal Advantages of Providing Educational Sarvioas at Non-RasMsntial Sitaa 
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clients (44.4%), greater commitment of clients (30.6%), less embarrassment associated with 
attending ''school** (29.6%), and a safer and more secure environment (213%). 

While the data presented in Figures IV-4 through IV-6 suggest that residential sites are 
particularly well-suited for the delivery of educational services to homeless adults, they also 
highlight the special advantages of non-residential settings. It is likely that the relative 
effectiveness of the two ty^ies of service delivery sites varies, depending upon the particular 
subpopulation served. Residential settings, because of their accessibility and comprehensive 
support systems, may be most appropriate for those individuals with special needs — e.g., 
recovering drug abusers, victims of spousal abuse, etc. — while non-residential settings may offer 
a more effective milieu for the marginally homeless, those who might otherwise eschew 
participation in a program too closely identified with the perceived stigma of homelessness. 
Future analyses of these data should address this issue in more detail. 

Otttreach> Incentives^ and Participation as a Condition of Residence 
Outreach Methods 

Simply providing educational services at locations that are physically accessible to 
homeless clients may be insufficient to ensure high rates of participation. Poorly educated adults 
often suffer from feelings of inadequacy and low self-esteem that may hamper, or even preclude, 
their participation. To overcome these psychological impediments, almost all local programs 
(97.4%) have implemented outreach programs designed to boost participation (see Figure IV-7). 
Nearly 9 in 10 of these programs employ interagency referrals and/or personal contacts (89.5% 
and 89%, respectively), more than two-thirds (68.9%) distribute flyers and posters, and about 3 in 
5 (60.5%) offer presentations or workshops to introduce prospective clients to the AEH program. 
Fewer programs employ media campaigns (47.4%) and fewer still have established toll-free 
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telephone numbers (10.1%). Fund-raising events, pot-luck suppers, and open houses represent 
additional means of getting the message out. 



FIGURE IV-.7 
OutTMeh Methods EmployMi Ijoomt Prograims 



P«rsonal Contttd/Word of Mouth - 
PrMMitations/Wortcshops - 
Toll-FtMi T«l«phOM NumtMr- 




10 20 30 40 50 60 70 80 00 100 
P m w mn XB o^ of lootd Progrmmm Employina Method 



D«ta Source: Local Piot^mm Survey: Prooimm Dt> (Q u o rt o n 35) 

Numbfof Ctw; 222 valid o— — , 2 ml— ing 0 M « t , nd a omwrn w not oonducting outr— eh icduckKi. 



Noto: Approximatoly ••van poroont of local programs omploy othor outrMCh mathods, induding 
fund-raiaing ovanta* pot-luck auppata, opan houaas, and ragular oontacta wHh aarvlca providara. 



Incentives for Participation 

Nearly three-fifths of service delivery sites (58.8%) use incentives to reward clients for 
participating in the AEH program. In addition to offering extended stays (discussed previously), 
incentives include certificates of achievement (77.9%)« gifts of clothing or other personal effects 
(37%), and special trips or outings (2L8%). Many local coordinators report that certificates of 
achievement — the most widely used incentive — represent an especially effective means of 
overcoming homeless clients* inhibitions and self-doubts. 
Participation as a Condition of Residence 

Approximately one-third of residential sites (35%) link the provision of shelter to 
participation in the AEH program, and, overall, about one-third of clients (35.6%) participate on a 
compulsory basis. Ai[:iong programs that provide educational services at residential sites, more 
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than one-half (Sl.2%) serve at least one site that requires participation, and about 15 percent 
provide services exclusively at such sites (see Figure IV-8). 
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While some program administrators question the educational effectiveness of linking 
participation to the provision of shelter, others see it as just another means of boosting 
enrollments. Not surprisingly, opinions vary according to individual administrators* experience. 
About 70 percent of those administering programs that require participation at all sites expressed 
the opinion that this approach results in greater duration and intensity of instruction, while only 21 
percent of those administering exclusively voluntary programs subscribed to that view. Most 
striking, however, is the fact that the vast majority (65.1%) of those administering "mixed" 
programs — i.e., programs that provide services at sites that require participation as wefl as those 
that do not — subscribed to the view that compulsory participation results in greater duration and 
intensity of instruction. Because of their direct comparative experience, the viewpoint expressed 
by these administrators is likely to be more objectively based than that of their peers. 
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Although, according to the collective judgment of these administrators, sites requiring 
participation may provide instruction of greater duration and intensity, this apparent advantage 
could be partially offset — or even negated — if participants at these sites aie not motivated to 
learn. Local program coordinators were asked whether clients who are required to participate in 
the AEH program as a condition of residence are more or less motivated than those who 
participate on a wholly voluntary basis. Again, responses varied according to the actual 
experience of administrators (see Figure IV-9). Approximately 43 percent of those who 
administered programs requiring the participation of all clients indicated that such clients tend to 
display greater motivation than those who participate voluntarily. The remainder were evenly split 
between those who associated compulsory participation with low motivation (28.6%) and those 
who found no difference in motivation according to program type (28.6%). Local coordinators of 
programs offering services on an entirely voluntary basis expressed a dramatically different 
opinion. Nearly three-quarters (73.6%) indicated that clients who are required to participate tend 
to be less motivated than those participating voluntarily. Administrators of mixed programs — 
those serving both sites that require participation and those that do not — generally supported this 
view (37.7%), but were almost equally likely to express the opinion that there is no difference in 
motivation according to program type (36.2%). 

While these findings raise provocative questions regarding the most appropriate program 
structure for the delivery of educational services to homeless adults, the questions that they raise 
cannot be answered in terms of these data alone. These issues will be taken up again in Chapter 
Vn, in the context of our investigation of program outcomes. 
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Support Services 
Homeless clients often have pressing needs that must be met before educational 
deficiencies can be effectively addressed. Individuals who are hungiry, in poor health, "strung 
out" on drugs, or suffering from emotional trauma are unlikely to be able to focus on education. 
Thus, in examining the accessibility of services provided through the AEH program, it is 
important to consider the availability and utilization of support services designed to meet these 
critical needs. 

Institutional Arrangements 

Legislation authorizing the Adult Education for the Homeless Program permits the use of 
AEH funds to support counseling, child care, and transportation provided in connection with the 
program*s broader educational goals. These and other services may also be provided by referral 
or through cooperative agreements with other agencies. While some local programs supplement 
AEH supported services through referrals or cooperative agreements alone — 29.1 percent and 6.4 
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percent, respectively — most employ a combination of the two (62.7%). Only about 1 in 50 

(1.8%) programs offers no support services at all. 

Tiie critical role that these services play in the overall educational process, and the 

important link that the AEH program provides to the broader conmiunity, are perhaps best 

described by a local program coordinator in North Carolina: 

The fact is, there are a lot of agencies in place to help the homeless, but until now 
[the AEH program], there has never been anyone or anything to assist the 
homeless in making the connections between the social service agency on one side 
of town, the substance abuse counselor on the other side of town, the job training 
agency in the middle of town, the vocational rehab service on the outskirts of 
town, etc. These clients, because of .^heir deficits, have lacked the wherewithal to 
make these necessary connections. The AEH program, through its unique position 
and emphasis on education as life-skills curriculum, has been able to assist the 
homeless in understanding and making the necessary connections for themselves. 
Because of this practical, hands on life skills approach to literacy, the AEH 
program is not just another weak attempt to throw money at a problem, but instead 
[represents] a viable, successful, working model for a solution to ending the 
homeless problem. (Burlington, NC: Local Program Survey, 1992) 

Provision and Utilization of Services 

About three-quarters (74%) of the clients participating in the AEH program receive 3 or 
more support ser\'ices, and more than 10 percent receive 10 or more such services. The 
percentage of local programs providing various support services — directiy or by referral — as 
well as the percentage of clients receiving or referred to each service are displayed in Table IV- 1. 

Case management services, as well as the essentials of food, shelter, and clothing, are 
provided by about 9 m 10 local programs. Among these, the most utilized is case management 
(73.5% of clients), reflecting its central role in the support services net^A^ork. Case managers 
assist clients by assessing their needs, providing counseling, and making referrals to other support 
services. Not surprisingly, more than 8 in 10 local program administrators (82.9%) rated this 
service as "critical** or "very important'* to the overall mission of the AEH program. 
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TABLE IV-1 



Percentage of Local Programs Providing Support Services 
(Directly or by Referral) and Percentage of Clients 
Receiving^eferred to Services 









HFood 


92.1 


61.4 


Case Management 


91.3 


73.5 


Shelter 


91.6 


58.4 


Clothing 


88.1 


49.0 


1 Substance Abuse Counseling 


84.1 


33.8 


1 Mental Health Counseling 


81.9 


23.0 


Health Care 


81.1 


36.6 


Job Skills Training 


78.0 


27.6' 


Job Counseling 


77.1 


39.2 


Job Referral 


72.2 


26.9 


Child Care 


70.9 


17.5 


Transportation 


66.1 


27.4 


Legal Counseling 


62.1 


11.0 


1 No Support Services 


1.8 


NA 



Data Source: Local Program Survey: Program Data (Questions 29, 32, and 33). 
Number of Cases: 227 valid cases; 3 missing cases. 

Note: Approximately 21 percent of local programs provide other support services (directly or 
by referral), including vision screening, AIDS screening/awareness programs, and parent 
counseling. 
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i Substance abuse counseling, mental health counseling, and health care are provided, either 

I directly or by referral, at more than four in five local programs and utiUzed by roughly one- 

quarter to one-third of participants. Among these services, substance abuse counseling is most 
" widely available (84.1%). while health care is most widely utilized (36.6%). Many programs have 

I successfully combined Ufe skills instruction in health care and substance abuse counseling with 

literacy training. In North Carolina, for example, several local programs employ a curriculum — 
" based on the Alcoholics Anonymous 12-step program — that simultaneously addresses clients* 

I needs for literacy instruction and drug addiction counseling. 

^ Also widely available are various support services aimed at enhancing clients* chances of 

' becoming gainfully employed. Job skills training, job counseling, and job referral services are 

I provided, directly or by referral, through most local programs (78%. 77.1%. and 72.2%. 

respectively), and about one-quarter to two-fifths of participants utilize these services. One 

V client's poignant testimony illustrates the potential impact of this type of service: 

■ [I learned] how to present my work experience in "stories" during interviews. For 
' the first time. I felt confident during a job interview, and the job I got is the job of 

my dreams. (Indianapolis. IN: Local Program Survey. 1992) 

' Child care is provided, either directly or by referral, by about 71 percent of local programs 

■ and utilized by approximately 18 percent of clients. This represents an especially critical support 
service in the case of many AEH programs serving victims of spousal abuse. At Family Tree, a 

V residential safe house for battered women in Colorado, clients contract with one another for child 

■ care during literacy instruction. Other local programs allocate AEH funds to provide child care 
directly. 

V Overall, nearly two-thirds of local programs offer some type of assistance with 

■ transportation, and more than one-quarter of participants make use of these services. In the case 
of non-residential sites, as well as residential sites that provide services to non-residential clients. 
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lack of transportation can present a major barrier to program participation. Some 36 percent of 
sites serving one or more non-residential clients offer transportation vouchers to participants and 
about 15 percent transport clients to and from classes in program-supported vans. 

Finally, homeless clients sometimes require legal assistance in contesting an eviction, 
obtaining child support, taking legal action against an abuser, or even in their own defense when 
charged with a crime. More than 3 in 5 local programs (62.1%) provide access to legal 
counseling and approximately 1 in 10 clients (1 1%) utilizes these services. 



CHAPTER V 
PROGRAM PARTICIPANTS 

If the AEH Program is to meet the educaiional needs of its clients, it is important to 
understand their characteristics and how they differ from those of other adult learners. Previous 
studies, reviewed in Chapter I, have demonstrated that the homeless are not simply a microcosm 
of the greater American society. They are disproportionately male, black, poorly educated, and 
often suffer from mental iUness, drug addiction, and other personal problems. But to what extent 
are AHH participants representative of homeless people in general and how do their educational 
accomplishments and literacy skills compare with those of other adult populations? 

This chapter addresses these issues in two parts. First, the characteristics of AEH clients 
are compared with those of the larger homeless population, and, second, the educational level and 
literacy skills of AEH participants are compared with those of two statistically representative 
samples of American adults. 

Characteristics of AEH Participant 

Demographics 

A recent Urban Institute study, based on interviews with some 1,700 homeless adults, 
describes the characteristics of the larger population from which AEH participants are drawn (Buit 
and Cohen, 1989). According to that report: 

• Most are males (81%); 

• Approximately 30 percent are between 18 and 30 years of age, SI percent are between 
31 and 50, 16 percent are between 51 and 65, and 3 percent are 66 years of age or 
older; 

so 
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• More than half are non-white (41% black, 10% Hispanic, and 3% other racial/ethnic 
groups); and 

• About 82 percent live alone, 9 percent are single parents, 8 percent live with an adult 
partner, and only 1 percent live in the company of another adult and dependent 
children. 

Although participants in the AEH program are similar in many respects to the greater 
homeless population, in some ways, they differ substantially. As shown in Figure V-I, the racial 
and ethnic composition of the two populations are strikingly similar — in each case, a majority 
are white, and blacks are disproportionately represented (Hispanics represent about 10% of each 
population). The age distributions of the two populations are also similar, although older 
individuals are somewhat less represented among AEH clients. 

In terms of sex and family status, however, the two groups differ markedly. According to 
Figure V-1, only 55 percent of AEH participants are male, as compared with 81 percent of all 
homeless adults. Moreover, while the vast majority of homeless are unattached adults (82%), 
AEH participants include substantial proportions of single parents (25.3%) and two-adult families 
with dependent children (10.6%). This latter difference is likely attributable to the fact that a 
substantial number of AEH programs specifically target victims of domestic violence, many of 
whom have dependent children. 
Employment Status and Duration of Homelcssncss 

The Urban Institute study also provides a basis for comparing AEH participants with the 
larger homeless population in terms of their employment histories and the duration of their * 
homelessness. According to that report: (1) about 94 percent of homeless adults lack a full- or 
part-time job; (2) they have been unemployed for an average of four years; and (3) they have 
been without permanent shelter for more than three years, on average. 

Figure V-2 presents equivalent daca for participants in the AEH program, /^bout 86 
percent of AEH clients were unemployed at enrollment — compared with 94 percent in the larger 
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homeless population — and more than three-qiuuters (75.5%) had been unemployed for just one 
year or less, averaging, overall, about 13 months. More than 7 in 10 AEH clients (70.2%) had 
been homeless for less than six months prior to enrollment, and the average participant had been 
without permanent shelter for just seven months. 

These data, when compared with the findings of the Urban Institute study, suggest that the 
AEH program tends to provide services to a particular segment of the homeless population — 
specifically, those who have been out of work and without shelter for relatively brief periods of 
time. Current outreach methods, though impressive, may simply be insufficient to attract those 
elements of the homeless population with prolonged histories of homelessness and unemployment. 
Alternatively, these individuals may have adapted to their homeless condition, effectively placing 
themselves beyond the reach of this or any other social program. Whatever the explanation of 
these findings, the AEH program, as currently structured, does not appear to reach the more 
chronic element of the homeless population — i.e., those individuals who literally *iive in the 
streets.*' The fact that the vast majority of AEH participants reside temporarily in either 
emergency shelters or transitional housing is consistent with this view. 
Subpopulations 

About one-third of the homeless are severely mentally ill, one-third or more have 
substance abuse problems, and between two- and three-fifths of homeless women have been 
abused over the course of their adult lives (D*Ercole and Struening, 1990; Interagency Council on 
the Homeless, 1989; Bassuk and Rosenberg, 1988). While data collected for this study do not 
pemut precise estimates of the proportion of AEH clients with these kinds of problems, crude 
approximations are possible.^ Many programs provide services at sites that specifically target 

' During site visits, it was learned that personal data of this nature were often unreliable or 
incomplete. Such information is generally not recorded during the enrollment process, either 
because staff do not feel qualified to evaluate complex personal problems of addiction and mental 
illness, or because clients are reluctant to reveal this information. 
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people with personal problems of one kind or another. The clients at these sites arc generally 
screened by experienced professionals or, in some cases, referred there by the courts or other 



with personal problems of addiction, mental illness, and abuse by examining the distribution of 
sites targeting these groups. 

In Figure V-3, the percentage of sites serving a majority of clients belonging to each of 
these groups is displayed. About one-third (31%) provide services to recovering substance 
abusers, another 1 in 10 (10.8%) serves victims of abuse, and approximately 8 percent serve the 
mentally ill. A comparison of these figures with estimates of the proportion of each group in the 
greater homeless population suggest that, while recovering substance abusers and victims of 
domestic violence are served by the AEH program in proportion to their numbers in the larger 
homeless population, the level of services provided to the mentally ill is more limited. 



government agencies. Thus, it is possible to gain some sense of the proportion of AEH clients 
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Educational Level and Literacy Skilk 

In this final section* the educational level and literacy skills of AEH clients are examined 
and the literacy skills of program participants are compared with those for two other adult 
populations. 
Educational Level 

At enrollment, most AEH programs record the educational level of participants by 
assigning students to one of two achievement levels. Level I signifies that a student has limited 
basic skills or is functioning at approximately the eighth-grade level or below, while Level II 
indicates that one has achieved relative competency in basic skills or is functioning between the 
ninth- and twelfth-grade levels. 

Figure V-4 describes the educational level of AEH participants in terms of these skills 
levels and in terms of the number of years of education achieved. AEH clients are approximately 
evenly divided between the two levels of achievement — about 45 percent at Level I and 55 
percent at Level II — and about 92 percent have completed no more than 12 years of education. 
Although AEH participants have less formal education than those in the greater homeless 
population — about one-fifth of whom have 13 or more years of education (Burt and Cohen, 
1989) — this is a]||^st certainly a function of AEH eligibility requirements. Legislation 
authorizing the AEH program states that the program is restricted to those who do not have ''a 
high school diploma, a GED, or the basic education skills to obtain full-time employment** 
(Federal Register, 1989). Thus, those who have a high school diploma as well as the basic skills 
to obtain employment are effectively excluded from program participation. 
Literacy Skills 

As part of this study, the literacy skills of a sample of AEH participants were assessed 
using the TALS Document Literacy Test. This instrument is designed to measure the knowledge 
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and skills needed to process information found in a variety of documents, such as tables, 
schedules, charts, graphs, maps, and forms. Because these skills are essential, both in managing a 
household and in meeting most job requirements, the performance of AEH participants on tiie test 
should be of interest to educators and policymakers alike. 

Altiiough the Document Literacy Test employs a scale ranging from 0 to 500, to facilitate 
interpretation of the proficiencies measured by the test, test developers have categorized scores in 
terms of five levels of proficiency. Each level is described below: 

• Level 1 (!S 225) — Level 1 proficiency Indicates the ability to perform relatively 
undemanding tasks, such as locating information based on a lite^ match or entering 
information from personal knowledge. 

• Level 2 (226-275) — Proficiency at this level demonstrates tiie ability to match 
information where there are several distractors or where the match is based on low- 
level inferences. Some ability to cycle through or integrate information is also 
required of individuals at this level. 
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• Level 3 (276«325) — Level 3 proficiency indicates the ability to integrate or cycle 
through material in relatively complex tables or graphs in which distractor information 
is present. 

• Level 4 (326-375) — Proficiency at Level 4 demonstrates the ability to perform 
multiple feature matching, cycling, and integration tasks, often involving conditional 
informadon that must be taken into account, and to make higher-level inferences. 

• Level 5 376) — Level 5 proficiency indicates the ability to search through complex 
displays containing multiple distractors, make high text-based inferences, or apply 
specialized knowledgv^*.. 

AEH participants score an average of 273 points on the Document Literacy Test, with 
approximately 17 percent scoring at Level 1, 37 percent at Level 2, 27 percent at Level 3, and 19 
percent at Level 4 (none scores at Level 5). The fact that a majority of participants exhibit 
proficiencies at Levels 1 and 2 is particularly noteworthy, as test developers suggest that skills 
evident at these levels place severe restrictions on an individual's ability to participate fully in the 
labor force. Equally striking is the fact that nearly one in five program participants exhibit 
proficiencies at Level 4. Individuals scoring at this level demonstrate proficiencies in coping with 
the kinds of complex literacy tasks that are increasingly common in the workplace and, thus, 
v/ovld appear to represent an untapped resource for the American economy. 

Figure V-5 displays mean Document Literacy scores for participants in the AEH program, 
disaggregated by demographic characteristics and several other variables. Most of the findings 
presented here conform to prior expectations: females score higher than males; younger 
participants score higher than their older counterparts; whites score higher than Hispanics, who, in 
turn, score higher than blacks; employed participants score higher than those who are unemployed, 
or employed only part-time; Level 11 participants score higher than those at Level I; and 
participants with more years of education score higher than those with fewer years of education* 
Somewhat less obvious are the findings relating to duration of unemployment and homelessness. 
The most recemly unemployed as well as these who became homeless just prior to enrollment 
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FIGURE V*S 

Mean Document Literacy Scores by Charecterletics of Clients 
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Data Source: Literacy Assessment (Enrollee Information Fonn» Questions 1, 2. 3. 4, 6. 7. 8, 9, and 10). 

Number of Cases: Sex - 359 valid cases/Age - 340 vaUd cases: 1 9 missing cases/Race/Ethnicity - 357 valid cases: 2 
missing cases/Employment Status - 343 valid cases; 16 missing cases/Number of Months Unempk>yed - 285 valid cases- 33 
missing cases; 41 cases employed full- or part-time excluded/Number of Months Homeless - 323 valid cases: 36 missina 
cases/Educational Level - 329 valid cases; 30 missing cases/Number of Years Eduattion - 344 valid cases; 15 missing cases. 

^ Mean score based on fewer than 10 cases. 



Note: Differences anrwng categories for each of the seven client characteristics are signifk^nt at the .05 level (one-way 
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score lower than those who have been unemployed or homeless for longer periods of time. While 
seemingly counter-intuitive, these findings may merely reflect heightened anxiety associated with 
the shock of sudden unemployment or the loss of permanent shelter. 
Cross-Study Comparisons 

Because the Document Literacy Test employs the same underlying framework as several 
recent assessments of statistically representative samples of adults, cross-study comparisons are 
possible. Figure V-6 compares the range of scores for new enroUees in the AEH program with 
those for representative samples of Job Training Partnership Act (JTPA) eligible applicants and 
Employment Service/Unemployment Insurance (ESAJI) participants. 

FIGURE V-6 

Comparison of TALS Document Literacy Scores for 
AEH New EnroUees, JTPA Qualified Applicants, and 
ES/UI Participants 
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While the three distributions displayed in Figure V-6 are remarkably similar, there are two 
notable differences. First, a greater proportion of AEH enroUees than JTPA-eligible participants 
demonstrate proficiencies at Level 4, and, second, more AEH enroUees than ES/UI participants 
score in the Level 1 -Level 2 range. These differences notwithstanding, the fact that the three 
distributions are so similar is consistent witii the view that homelessness is not simply a function 
of poor literacy skills, but involves other variables as well, including personal problems of 
addiction, mental illness, and abuse, as well as the lack of adequate social supports. 
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CHAPTER VI 
EDUCATIONAL SERVICES 



Overview 

Ultimately, the success or failure of any educational program rests upon its ability to 
provide effective educational services. In thiis chapter, the Adult Education for the Homeless 
Program is examined in terais of several factors commonly associated with program effectiveness. 
These include: (1) the intensity and duration of services; (2) the content of instructional 
programs; and (3) the curricula and instructional practices employed in the delivery of services. 

Intensity and Duration of Services 

Expenditures Per Client 

Each year, the AEH program*s limited resources pose an ever greater challenge to its 
ability to meet the educational needs of homeless adults. Since the program*s inception, in 1987, 
demand for services has nearly tripled, while Federal appropriations have increased by less than 
50 percent. 

Today, the average local program spends just $291 in AEH iunds to provide services to 
each of its clients, and, in some areas, where demand is greatest, program expenditures average as 
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litUe as $7 per client.^ By comparison, the average learner cost of publicly supported workplace 
literacy programs is nearly $3,000, and the most effective private programs report average costs 
more than double that (Mikulecky and d'Adamo-Weinstein, 1991). 
Duration of Services 

The high rate of mobility among homeless individuals poses an additional obstacle to the 
effective delivery of educational services. Only about one-third of program participants receive 
services for more than three months, and, for the remainder, the average length of program 
participation is just three weeks. 

While almost one-third of program participants (28.1%) receive more than 40 hours of 
instruction, nearly two-fifths (37.8%) receive 10 hours or less (see Figure VI-1).^ These figures 
are low, especially when viewed in light of recent evidence suggesting that the most effective 
workplace literacy programs, which spend substantially more per client than AEH programs, 
require between 50 and 100 hours of instruction to produce even marginal learner gains 
(Mikulecky and d'Adamo-Weinstein, 1991). 



^ These figures are based on the expected number of clients reported by program personnel on 
the local program survey. Our individual client survey provides an alternative way to estimate the 
number of clients served in a year. We collected data on each client entering in June, so we can 
count the number of clients entering each site, and aggregate across sites within programs to 
esitmate the number of clients entering m June. Assuming tha» an average n»nnber of clients enter 
programs in June, we can multiply the ?5wmber of clients entering in June by 12 to estimate the 
number of clients served over the coun^e of a year. Using this method, we estimate that the 
average program serves 102 clients. By this calculation, the largest program serves 1,560 clients 
in a year. Using these figures, the average program spends $410 per client, 75 percent of 
programs spend $115 or more per cUent. The highest spending program spends about $5,000 per 
client, and the lowest spending program spends only about $13 in AEH funds per client. 

^ The data presented in Figure VI- 1 pertain to a three-month reporting period immediately 
following enrollment and, therefore, represent conservative estimates. Additional hours of 
instruction for those participants who remain in the program for more than three months are not 
reflected here. 
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FIGURE VM 

Numb#r of Hours of Instruction Rscslvsd by AEH Cllsnts 
(Now Enrolisss for Juns 1992) 



40 




1 ! I I I I 

^ 10 Hr». 11-20 Hrs. 21-40 Hrs. 41-60 Hi^. ©1-80 Hrs. 81-100 Hrs. > 100 Hr». 



Numbsr of Hours of Instruction 

I Data Souroa: LooaI Program Surwy: CHant Dste (GKiwtlon 14) 

Number of Casss: 2»837 valid casaa; 111 missing casas 
M Nota: nguratobasadonoansoraddataforathraa-rnonthraportingparfc>d. Approximatal/ 34 paroant of 

■ ollants oontlnua to pamdpata In tha AEH program bayond lha ihraa-month panod. 

I Content of Instruction 

jm Background 

Another important factor associated with the effective delivery of educational services is 
I the degree to which the content of a program's instmction addresses the needs of its clients. 

0 Accordmg to Darkenwald and Valentine (1984), adult education programs often fall short m this 
regard. These authors contend that a substantial proportion of skills learned m ABE programs are 

1 ''meaningless/' in the sense that they are never applied outside of the classroom. Aduh learners, 
M in particular, must perceive instruction to be relevant beyond an academic context or they may 

begin to lose interest and, ultimately, drop out (Grubb et al., 1991; Sticht, 1988). 

■ However, the application of newly acquired skills to real-life situations often deper is as 
B much on learners' self-confidence as on their proficiency (Fingeret and Danin, 1991). Indeed, 

when participants in adult education programs were asked to identify **the most important benefit" 
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of paiticipation, effective outcomes (i.e., self-confidence and self-esteem) ranked nearly as high as 
academic improvement (Darkenwald and Valentine, 1985). 
AEH Instractional Programs 

The Adult Education for the Homeless Program addresses these concerns by emphasizing 
instructional programs that integrate basic skills with life skills training, and other programs 
specifically designed to meet the affective needs of homeless clients. 

Figure VI-2 displays the distribution of service delivery sites offering various programs of 
instruction. Life skills training programs are most widely available (83.1%), followed by 
programs in adult basic education (82.7%), GED preparation (81.4%), self-esteem development 
(67.1%), and employability skills (68.3%). In addition, about one-quarter of sites provide 
instruction in English as a second language (28.6%) and adult secondary education (23.6%). 

FIGURE VI-2 
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Client demand for various instnictional programs — as indicated by enrollments — is 
described in Figure VI-3. According to these data, demand for life skills training programs is 
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nearly twice that for any other mstructional area (&5%\ and demand for programs addressing the 
afifective needs of clients ranks second (44.8%). Somewhat fewer clients participate in programs 
in adult basic education (42.5%), employability skills (33.4%), and GED (33.4%), and fewer still 
receive instruction in adult secondary education (6.8%) and English as a second language (5.3%). 
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Instinctional Practices and Curricula 

The educational effectiveness of AEH programs is further influenced b> the various 

instructional practices and curricula employed in the delivery of services. As indicated in 

Chapter V, homeless clients do not constitute a homogeneous population and, thus, one would not 

expect to identify a single ideal program model Rather, a variety of effective approaches, 

strategies, and cumcula are likely to exist, depending on the particular characteristics of clients 

served. As Fingeret (1984) explains: 

The question confronting the aduh literacy conmiunity is not ''Which program 
model is better?" or "Which set of underlying assumptions is true?' Rather, 
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educators must question which approach appears to meet the needs of which 
persons in particular circ?imstances. 

This section addresses these issues in two parts. First, the utilization and perceived 
effectiveness of various educational practices (i.e., instructional approaches and strategies) are 
investigated, and, second, the various curricula employed in the delivery of educational services 
are examined. 
Instructional Practices 

At most AEH service delivery sites, a broad range of instmctional approaches and 
strategies is employed, and, therefore, instractors at these si;u:^s are in a unique position to evaluate 
the effectiveness of one approach or strategy vis-a-vis that of another. For this study, principal 
instructors at each site were asked to specify which of the various approaches and strategies 
employed at their site had proven most effective. Because the effectiveness of various practices is 
likely to vary according to the characteristics of clients served, these data are analyzed in two 
ways — first, tor aU sites combined and, then, separately, for sites targeting one of three principal 
subpopulations. 

Instructional Approaches 

Figure VI'4 displays the percentage of sites employing various instructional approaches 
and the percentage of sites at which each approach is judged to be "most effective." Overall, 
individualized instniction is the most widely utilized approach (90.4% of sites) and, according to 
principal instructors* ratings, also the most effective (59.2%). Small group instruction is 
employed by nearly as many sites (78.8%), but less highly rated in terms of effectiveness (21.8%). 
Other instructional approaches — self-instruction, peer tutoring, large group instruction, and 
computer-assisted instruction — although employed by one-third to one-half of all sites, rank 
consistently lower in terras of perceived effectiveness. 
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FIGURE VM 
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Figure VI-S presents data pertaining to the distribution and perceived effectiveness of 
various instructional approaches, separately, for sites targeting each of three subpopulations — 
victims of spousal abuse, recovering substance abusers, and the mentally ill. One noteworthy 
finding presented here pertains to those sites targeting the mentally ill. Individualized instruction 
is more widely employed at these locations (93.5%) and more often judged most effective 
(71.7%). In comparison, large group instruction is utilized at one-half of these sites, but identified 
as the most effective instructional approach at only 1 in 10 (10.8%). Deficiencies in interpersonal 
skills — a common characteristic of mentally ill clients — may render instructional approaches 
that require group interaction more threatening and, hence, less effective. Moreover, because 
individualized instruction is designed to proceed at the pace of the individual learner and to 
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provide inpunediate feedback and encouragement, this approach may be better suited for mentally 
ill clients, 

Instructional Strategies 

Service delivery sites also employ a wide range of instructional strategies designed to 
enhance the effectiveness of educational services. Figure VI-6 displays the percentage of sites 
employing various strategies and the percentage of sites at which each strategy is judged to be 
most effective. Overall, v/orkbook-based instruction is the most widely utilized strategy (87.9% 
of sites) and, based on the ratings of principal instructors, also the most effective (40.9%).^ 
Cooperative learning, a relatively new instructional strategy, ranks second in both prevalence 
(64.2%) and perceived effectiveness (25.0%). Other strategies — creative writing, experiential 
learning, and intergenerational learning — are less widely utilized and, witii tiie exception of 
experiential learning, rank substantially lower in terms of perceived effectiveness. 

Figure VI-7 displays data pertaining to the distribution and perceived effectiveness of 
various instructional strategies, separately, for sites targeting each of tiie tiiree subpopulations 
examined above. Two findings are particularly noteworthy. Fust, at sites targeting victims of 
abuse, cooperative learning is judged to be highly effective, while mtergenerational learning, 
tiiough widely utilized at Uiese sites, ranks relatively low in perceived effectiveness. Second, at 
sites targeting Uie mentally ill, experiential learning is rated among tiie most effective instructional 
strategies, second only to workbook-based instruction. For tiie most part, tiiese findings are not 
surprising. It seems reasonable that women suffering from abuse would find comfort in a 
cooperative learning format in which life experiences may be shared. Nor is it surprising that a 
strategy that emphasizes real-life experiences would be particularly effective in providing 
educational services to mentally ill cUents. However, it is less clear why intergenerational 

^ Workbook-based instruction may employ conunercially developed materials or materials 
developed by teaches and/or students that are presented in a workbook format. 
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learning is so seldom rated among the most effective strategies at sites serving abused women. 
Despite several anecdotal accounts which suggest the effectiveness of this strategy at these sites, it 
is rarely rated among the most effective instructional practices. 
Curricula 

Because of the AEH program's emphasis on individualized and small group instruction, 
instructional materials are often customized to meet the needs of individual learners or groups of 
learners. Although most sites supplement customized instructional materials with commercially 
prepared materials (84.4%), only 1 in 10 sites (10.7%) relies exclusively upon commercially 
developed curricula. 

Given the limited resources allocated to curriculum development, the widespread use of 
customized instructional materials is remarkable. On average, states allocate less than 1 percent 
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(0.6%) of budget to curriculum development costs, and local programs spend even less (0.4%). 
Yet, two-thirds of AEH state projects report that curricula designed for use with homeless adults 
have been developed in their state. These include: (1) existing curricula that have been 
substantially modified; (2) curricula developed as part of a regional consortium; and (3) curricula 
developed at the local program level (with or without state support). 

Typically, these curricula are designed to meet the needs of smaller groups of individuals 
within the greater homeless population. Figure VI-8 displays the percentage of states in which 
curricula designed for various subpopulations have been developed. Most states have focused 
attention on the development of instructional materials for families (60%) and single women with 
children (50%), while fewer have developed curricula for victims of spousal abuse (45%), single 
men (45%), substance abusers (40%), and young adults (40%), and fewer sdll have developed 
materials designed for single women (35%), limited English proficient clients (25%), the mentally 
ill (20%). learning disabled clients (15%), Native Americans (15%), and veterans (15%). 
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The fact that the greatest emphasis has been placed on the development of instructional materials 
for families and single women with children is somewhat surprising, considering that these two 
groups comprise just one-third (35.7%) of the homeless adults served by the AEH program. 
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CHAPTER VII 
PROGRAM OUTCOMES 



Overview 

m A program's educational effectiveness is best determined by means of a careful evaluation 

M of outcomes associated with its implementation. Unfortunately, the vast majority of evaluations of 

adult literacy programs fail to consider the full range of potential outcomes and seize quickly 

■ upon what is measurable in a reliable, objective, and efficient manner (Valentine, 1992). In more 
I meaningful evaluations, a thorough understanding of a program's objectives precedes and guides 

the evaluation of program effectiveness, and the choice of outcomes is based on the goals that a 

■ program sets for itself. 

I Even when outcomes accurately reflect program objectives, in the absence of a carefully 

designed experiment, it is virtually impossible to assert with confidence that observed changes are 

■ attributable to program participation. In non-experimental evaluation designs, various threats to 
I internal validity — selection, maturation, and historical effects, in particular — must always be 

considered in interpreting outcomes (Campbell and Stanley, 1963). In the case of programs in 

■ which participation is primarily voluntary, it is especially important to recognize that participants 

■ and non-participants may differ substantially in terms of motivation. Those who enroll in adult 
literacy programs may exhibit the propensity to grow and change even in the absence of program 

m involvement. Maturation effects — intra-individual processes that vary systematically with the 

■ passage of time — represent another potential threat to validity. Although often disregarded, 
decades of research on aduh development has established that adulthood is not a static state but, 

■ rather, involves social priorities and "developmental tasks" that evolve as one moves through 

■ various phases of adulthood (Cross, 1981). Finally, historical effects related to macro-level 
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changes — such as an upturn in the economy or a drop in unemployment — must also be 
considered in interpreting outcomes, especially those that involve the application of newly 
acquired skills. 

Threats to internal validity, such as those described here, are less critical in what Stake 
(1967) refers to as "relative evaluation designs,'' in which a program is compared, not with a 
control group or with a set of absolute standards but, instead, with other programs serving similar 
populations in similar temporal and social contexts. Moreover, the results of such evaluations are 
likely to prove more valuable to program administrators by highlighting those processes that are 
associated with the relative effectiveness of programs in achieving specific outcomes. 

Guided by these considerations, the present chapter examines various outcomes associated 
with the Adult Education for the Homeless Program. The chapter consists of three related 
sections. First, employing a conceptual framework suggested by Valentine (1992), the underlying 
objectives ov the AEH program arc described. Second, based on measures that reflect these goals, 
program outcomes are evaluated. Finally, adopting a relative evaluation perspective, outcomes are 
examined in relation to various program stmcturcs, instractional practices, and client 
characteristics. 

Program Objectives 

Outcome Levels 

Valentine (1992) has proposed a model of the outcomes of adult literacy education that is 
designed to facilitate evaluations of program effectiveness. According to this approach, outcomes 
fall into one of three categories, or "levels.*' Level one outcomes occur within the individual 
program participant and include skill acquisition, information acquisition, and affective changes. 
Level two outcomes — resulting from the application of level one outcomes — represent changes 
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■ in behavior outside of the exlucational setting and manifest themselves in actions associated with 

■ various adult social roles, including that of citizen, community member, household decision- 
maker, parent, spouse, and worker. Fmally, level three outcomes represent the cumulative impact 

" on society of the actions comprising level two outcomes. 

■ AEH Program Objectives 

This conceptual model provides a useful framework for examining a program^s objectives 

• and offers a rational basis for selecting appropriate outcome measures. It is employed here to 

■ describe the objectives of the Adult Education for the Homeless Program — at the Federal, state, 
and local levels. 

* Federal Obiectives 

■ Although, collectively, the McKinney Act programs are designed to reduce homelessness 
on a societal scale (level three outcome), authorizing legislation does not posit this as an explicit 

■ objective of the AEH program. 

W Although level one outcomes are implicit in Federal authorizing legislation, the program*s 

goals are described largely in terms of level two outcomes, especially those pertainmg to 

■ employment and self-sufficiency among homeless adults. Thus, the McKinney Act defines 

■ "literacy training** as: 

^ ... adult education for homeless adults whose inability to speak, read, or write the 

■ English laiguage constitutes a substantial impairment of then: ability to get or 

■ retain employment commensurate with their real ability, that is designed to help 
eliminate this inability and raise the level of education of those individuals with a 

I view to making them less likely to become dependent on others, to improving their 

■ ability to benefit from occupational training and otherwise increasing their 

^ opportunities for more productive and profitable employment, and to making them 

■ better able to meet their adult responsibilities. {Federal Register, 1989) 

And, in the more recently enacted National Literacy Act of 1991, "literacy" is defined as: 

■ ... an individual's ability to read, write, and speak in English, to compute and solve 
problems at levels of proficiency necessary to function on the job and in society, to 

m achieve one's goals, and to develop one's knowledge and potential. 
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State Objectives 

At the state project level, relatively more emphasis is placed on level one outcomes, 
although level two outcomes are also recognized as relevant to the program's underlying purpose. 
Figure VII-l displays the principal objectives of AEH state projects, based on the responses of 
project administrators. All state administrators recognize improvement in basic skills and life 
skills as principal program objectives. In addition, most name self-esteem development (93.8%), 
GED/adult secondary education (87.5%), pre-employment training (71.9%), and English as a 
second language (59.4%) as important program goals. Independent living/housing acquisition — 
the only explicitly level two outcome cited by these administrators — ranks last (37.5%). 
However, several other outcomes cited — i.e., life skills improvement, GED/Adult Secondary 
Education, and pre-employment training — are obviously intended to further level two objectives. 
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Local Objectives 

Lx)cal programs also define program objectives largely in terms of level one outcomes, 
especially those pertaining to personal goal achievement and intra-individual affective changes. 
This is revealed in Figure Vn-2, which presents the percentage of sites at which various outcomes 
are named among the three leading measures of program success. At a majority of sites, the 
achievement of personal goals and social/psychological gains rank among the three leading 
indicators of success (58% and SO.3%, respectively). In addition, obtaining or making progress 
toward the GED is named by two in five sites (41.8%), and completing or making progress in 
Level I is named by nearly one-third of all sites (31.2%). However, only three level two 
outcomes — obtaining or improving employment, obtaining housing, and getting off welfare — 
are identified as leading measures of success and, in each case, by fewer than one in five sites. 

Description of Program Outcomes 

The preceding analysis demonstrates that Federal, state, and local authorities place 
different emphases on the various objectives of the AEH program. While Federal guidelines 
focus more on goals related to the application of skills outside the classroom, state projects tend 
to emphasize skill acquisition, and local programs underscr * e importance of personal goal 
accomplishment and intra-individual affective changes. w\ no single perspective is right or 
wrong. Rather, in combination, the various goals and objectives expressed at each administrative 
level comprise the program*s overall purpose. 

Viewed in the context of Valentine*s conceptual framework, these findings indicate that, 
overall, the objectives of the Adult Education for the Homeless Program are most accurately 
reflected in a combination of level one and level two outcomes. Below, following a brief 
discussion of methodological issues, outcomes at each level are examined. 
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FIGURE Vli-2 

Percentage of Sites Naming Various Measures of 
Success Among the Top Three 
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Data Source: Local Program Survey: Site Data (Question 43) 
Number of Cases: 581 valid cases; 7 missing cases. 

Kii^if SLn'^^f four percerit of sites named measures of succass other than those shown here, 
Including self-assessments, staying clean and sober, and dally incident reports. 
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Methodological Considci^tions 

In this study, outcome data are derived from program records for all clients who enrolled 
in the AEH progr.^ in June 1992 and pertain to the three-month period following each client's 
enroUment. While approximately two-thirds of program participants leave the program within 
three months, any program effects accruing to the remaining one-third after that period are not 
reflected in these data. The findings presented m this section thus represent conservative 
estimates of the varioas outcomes associated with program participation. 

To some degree, operationalizmg outcomes in this way offsets tae potentially inflationary 
effects of the various threats to validity reviewed earlier. Moreover, maturation and historical 
effects may be somewhat less critical given the limited time-span over which data arc collected. 
Finally, because about one-third of program participants are required to enroll in the AEH 
program as a condition of residence, the potential for selection bias is proportionately reduced. 
Acquisition Skills (Level One Outcomes) 

Level one outcomes — i.e., those that occur within the individual program participant — 
are emphasized at the state and local levels. According to Valentme (1992), outcomes at this 
level include skills/information acquisition and affective changes. However, because local AEH 
programs have experienced difficulty collecting data pertaining to affective outcomes, in the 
present context, level one outcomes refer only to educational accomplishments. 
Summary Measures 

Figure VII-3 presents summary data describing various educational accomplishments of 
AEH program participants. An overwhelming majority of participants accomplished one or more 
personal goals (81.6%), 3 in 5 moved up from Level I to Level II or within level^ (61.3%), 1 in 5 

^ Adult educators often measure educational gains in terms of movement from Level I to 
Level n (see Chapter V for a description of the two levels). In this study, this measure has been 
extended to include intraJevel gains, thus providing a more discrimmatmg measure of 
achievement. 
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was admitted to another educational program (23.1%), 1 in 20 received a GED (5.7%), and 
approximately 1 in 50 received an adult secondaiy education diploma (2.1%). Furthermore, 
among clients enrolling in English as a second language (ESL) programs, a majority (53.7%) 
moved up one or more ESL levels. 
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GED Test Scnry f.pinc 

In several cases, client records contained GED test score data for two or more 
administrations of the GED or GED practice tests. For these clients, it is possible to assess actual 
changes in GED scores in relation to program participation. Table VH-l displays the mean 
change in GED test scores for these individuals and the mean number of instructional houre 
between test administraaons. Although the average client received less than 20 hours of 
instniction between test administrations, average scores increased significanUy - by about five 
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points — in each of the five GED subject areas. While these findings are encouraging, one is 
unable to conclude from these data alone that such gains represent progrim effects. Indeed, the 
fact that the number of instructional hours received between test administrations is unielated to 
test score changes in each of the five GED subjea areas (not presented here) suggests that the 
observed gains may be attributable to the effects of testing. 

TABLE VIM 

Mean Change in GED Test Scores for Clients Taking 
the GED/GED Practice Test on More Than One Occasion 
(New EnroUees for June 1992) 



GED 
Test Area 


iSwnTIist Score : ■ 


Mean Change 
in Score 


Mean Nmnber 

: Instniction 
B^cen Test 
Administrations 


> First .^-^T-:. 
Administraiion 


■ Second 
Administration 


Math 


40.0 
(57) 


45.2 
(57) 


5.1** 

(57) 


18.6 
(57) 


Science 


44.0 
(49) 


48.2 
(49) 


4.2** 
(49) 


16.6 
(41) 


Writing 


42.0 
(41) 


47.2 
(41) 


5.2** 
(41) 


18.7 
(34) 


Social Studies 


44.3 
(52) 


49.8 
(52) 


5.5** 

(52) 


17.9 
(41) 


Literary Arts 


44.1 
(57) 


49.1 
(57) 


5.0** 

(57) 


16.6 
(49) 



Data Source: Local Program Survey: Client Data (Question 20). 

Number of Cases: The number of valid cas^s for each cell of the table are presented in 
parentheses. 

Paired-sample t-test significant at the .01 level (one-tailed test). 
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Life Skills 

For this study, a unifonn reporting instrument based on an adaptation of tlie CASAS core 
competencies was developed to collect data pertaining to life skills achievement. Seven life skill 
areas were identified — community resources, social skills, consumer economics, occupational 
knowledge, health and government/law — and data pertaining to clients* accomplishments in as 
many as four skills within each area were collected. 

Accomplishments in each of 21 life skills were rated by instructors at each site — 0 = no 
progress, 1 = some progress, 2 = much progress, and 3 = successfully completed — and a 
summary measure of life skills achievement was computed by summing these ratings and dividing 
by the number of skills in which instruction was received. On average, clients received training 
in 8.6 life skills and exhibited a mean life skills achievement score of 1.5 (approximately half-way 
between "some" and "much'' progress). 

Figure Vn-4 presents the percentage of clients receiving instruction in each of the 21 life 
skills and the percentage that either "successfully completed" instruction or made "much progress'* 
in each area. Those life skills in which a majority of participants received instruction include 
conamunity agencies and services (65.1%), communication/interaction (62.7%), personal 
budgetmg/flnance (57.7%), locatmg employment (57.7%), and decision making (54.9%). Fewer 
participants received instruction in skills pertaining to leadership (30.4%), parenting (28.9%), legal 
rights/responsibilities (27.5%), voting/political process (26.4%), medications (26.1%), and taxation 
(14.6%). For the most part, accomplishments were comparable across the various skills for which 
data were collected. Between one-third and one-half of those receiving instruction in each of the 
21 life skills either successfully completed instruction or made substantial progress. 
APDlication of Skills (Level Two Outcomes) 

Although level one outcomes are implicitly included within the framework of Federal 
authorizing legislation, level two outcomes, to particular, are emphasized by Federal program 
authorities. On the other hand, state projects and local programs tend to focus somewhat less on 
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FIGURE Vli-4 

Percentage of Clients Receiving and Malcing Progress in Life Skills Instruction 

(New Enrollees for June 1992) 
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the actual applicaUon of skills to real-world contexts than on the acquisition of these skills.^ In 
part, this may be due to the fact that data pertaining to such outcomes are difficuft to obtain, 
particularly in the case of homeless adults. Whatever the reason, any evaluaUon of AEH program 
outcomes would be incomplete without examining the program's success in transforming the 
homeless men and women it serves into independent, productive, and responsible members of 
society. 

Data pertaining to various level two outcomes are presented in Figure Vn-5. In most 
cases, because records are often incomplete in this area, findings are based on less than one-half 
of the fill! participant sample. ConsequenUy, these data should be interpreted cautiously. Nearly 
2 in 5 clients (with complete records) obtained or improved their employment (38.4%), and about 
1 in 10 got off welfare (11.8%), registered to vote for the first time (11.6%), and/or obtained a 
driver's license (8.5%). In addition, 1 percent of clients (1.2%) obtained U.S. citizenship. 
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CHAPTER VIII 
WHAT WORKS 



While the foregoing chapter examines the overall impact of the AEH program in terms of 
various outcomes, this chapter focuses on the relationships among outcomes and a variety of 
instructional practices* program structures, and learner characteristics. The goal of tibds analysis is 
to identify those contexts and practices that make programs more or less effective in achieving 
various outcomes. As Hayes (1992) observes, 'through such comparisons we can begin to 
determine what instructional practices seem to be most effective in achieving certain outcomes 
given certain contexts and certain learners.** 

Identification of effective instmctional practices requires multivariate analysis. Many 
aspects of instruction tend to occur together (for example, most learners receiving small group 
instruction also receive individual instruction). Thus, the effects of one practice may confound 
estimates of the effects of other practices. Similarly, some instructional practices are more 
common at some types of sites, or sites serving some types of clients, than are other practices. 
Analyses that ignore these interrelationships risk overlooking effective practices or overstating the 
impact of less effective practices. Therefore, our assessment of th^ efficacy of instructional 
approaches considers all of these factors simultaneously. 

The analyses presented in this chapter focus on the factors influencing two types of 
outcomes: student persistence (as measured by the number of hours of instruction that they 
receive) and academic achievement. We target two measures of academic achievement: whether 
clients are reported to advance academically, and whether students enrolled in GED programs 
receive a GED certificate. 



131 

111 



Of course, an almost infinite list of client and site traits may influence learner success in 
the AEH program. These analyses concentrate on several characteristics and instructional 
approaches that instructors identified as particularly effective (sec Chapter VI). In addition, we 
control for client characteristics and other program features that are likely to influence student 
success. These factors can be grouped into three general categories: 

• Site characteristics. This includes the context of instruction (whether a site is non- 
residential or residential, and if it is residential, whether or not AEH participation is 
required for residence); urbanicity of the site; the primary population served at the site; 
and the student/teacher ratio. 

• Student participation. This includes the type of educational programs in which 
learners enroll (e.g., ABE, GED, etc.) and the types and amount of instruction that they 
receive; 

• Student characteristics. This includes the students' age; gender; amount of time 
homeless; prior education; academic level at entry; employment status; and duration of 
unemployment if they are unemployed. 

From a policy perspective, some of the site characteristics and smdent participation 
indicators may prove most interesting. Specifically, the provision of shelter is a key issue in 
delivering any service to people who do not have homes. Many instnictors who responded to our 
survey believed that educational services could be delivered more effectively at residential sites. 
While tiiey expected that j:equiring program participation increased attendance, tiiey also believed 
tiiat clients who were compelled to attend were less motivated, implying tiiat it might be more 
difficult to educate them. Arc residential sites better? Do residential sites tiiat require AEH 
participation as a condition of residence see lower academic achievement? These are some of tiie 
policy questions addressed in this ch^ter. 

Other questions center on student participation. The impact of AEH programs is limited 
by the amount of instruction that learners receive. Programs that more effectively encourage 
participation and persistence stand a better chance of improved outcomes. Beyond this, some 
modes of instruction may prove more effective tiian otiiers. Our survey of principal instructors at 



each site revealed a widespread belief that individual and small group instruction were the most 
effective modes of instruction. However, while respondents at nearly three in five sites judged 
individual instruction to be the most effective (59.2 percent), only about one in five respondents 
judged small group instruction to be the single most effective strategy (21.8 percent). The 
multivariate analyses presented in this chapter provide an opportunity to assess the relative 
efficacy of these various modes of mstruction. 

This chapter proceeds in four sections. The first section below catalogues some of the 
differences in the client and site characteristics across different types of sites. The second section. 
Student Participation, estimates the amount of instruction that students receive in AEH programs 
using multivariate methods to identify student and site characteristics that influence the amount of 
instruction received. The third section. Academic Achievement, again draws upon multivariate 
statistics, this time to identify factors (including the type and amount of instraction received) 
influencing learning. The final section briefly summarizes the key findings from this chapter. 
Differences Across Types of Sites 

Sites with different characteristics often serve clients with different characteristics. As a 
prelude to the multivariate analyses of the subsequent sections, this section begins to develop 
portraits of different types of sites in terms of the clients that they serve, the modes of instruction 
they offer, and other characteristics that distinguish one site from another. 

We begin this description by grouping AEH sites into three mutually exclusive categories 
that address an issue of key policy concern: whether the sites provide residence and whether this 
shelter is conditional on program participation. Thus, the three types of sites are: 

• non-residential sites; 

• residential sites in which AEH participation is not required as a condition of residence 
(residential-voluntary); and 
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• residential sites in which AEH participation is required as a condition of residence 
(residential-compulsory). 

The characteristics of clients attending the different programs are, indeed, different. For 
example, clients at compulsory sites tend to have more years of prior education, are less likely to 
be women, have been imemployed for less time, and are more likely to participate in lifeskiUs and 
Adult Basic Education (ABE) programs. Other characteristics of the sites also differ. 
Student/teacher ratios tend to be highest at compulsory sites, clients at non-residential sites are 
likely to be instructed by staff with less postsecondary education, and clients at compulsory sites 
are more likely to find themselves at programs serving primarily recovering drug addicts and 
alcoholics. These differences are described in detail below. 

Site Characteristics 

Table Vni-l presents the percent of clients enrolled in sites with various site 
characteristics. Perhaps the most striking set of figures in this table concern the studentAeacher 
ratios at the different types of sites.^ Clients at compulsory sites were far more likely to be 
enrolled at sites with high student/staif ratios — almost 60 percent were in sites in which more 
than 10 students enrolled (during the month of June) for each staff member on site. The 
corresponding figure is only 12 percent for voluntary-residential sites, and 16 percent for non- 
residential sites. Student teacher ratios were most favorable at non-residential sites, where over 
half of the students were enrolled in sites with three or fewer students per staff member. 

The geographic distribution of sites also varies. Residential sites are not typically located 
in rural areas. Rural, residential-compulsory sites are particularly rare. 



^ These figures represent the number of new entrants during the month of june, divided by the 
number of staff members. The actual studentAeacher ratios are affected by many other factors, 
including the regularity of attendance, the persistence of clients, etc. However, this is the best 
indicator available, and it is reasonable to expect this indicator to be highly correlated with better 
measures of the studentAeacher ratio. 
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Table Vill i 

Percent of Clients in Sites with Various Characteristics 





Residential 






Compulsory 


Voluntary 


Non>Residential 


1 Site Features 


(percent of 
dients) 


(percent of 
clients) 


(percent of 
cuents) 




(n = 1072) 


(n = 1264) 


(n = 529) 


Student/Staff ratio — 
clients entering during June per 
staff member 
<3 

Between 3 and 10 
II More th;an 10 


17.4 
23.5 


28.3 
59.8 
11.9 


54.6 
29.5 
15.8 




(n = 1078) 


(n = 1276) 


(n = 529) 


1 Location 

Urban 
Rural 

Town or Suburb 


35.5 
6.7 
57.1 


36.9 
7.8 
55.2 


23.4 
14.8 
60.5 


Support Services 

Transportation vouchers 
Child Care 


44.2 
36.6 


41.8 
43.6 


44.8 
29.0 




(n = 1016) 


(n = 1080) 


(n = 502) 


Staff Credentials: 
1 Average years of post- 
1 secondary education 

0-2 

3-4 

II 


8.2 
48.9 
42.9 


10.0 
46.3 
43.8 


10.4 
35.7 
54.0 




(n = 1078) 


(n = 1276) 


(n = 529) 


Average Years of Adult Ed 
Teaching 

0-1 

1.1-4 

>4 


17.0 
31.5 
51.5 


15.0 
42.0 
43.0 


16.6 
39.7 
43.7 
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Table VIII-1 

Percent of CUents in Sit^ with Various Characteristics 

(Continued) 





Residential 






Compulsory 


Vblnntaiy 


Non-Residential 


Site Features 


(percentof 
clients) 


(percentof 
cUents) 


(percentof 


Instructional Strategies 
Coop, learning 
Intergenerational 
Experiential 
Workbook 
Creative writing 
Other 


(n = 1078) 


(n = 1276) 


(n = 529) 


64.8 
17.7 
45.4 
80.2 
58.4 
20.7 


66.9 
18.4 
44.4 
84.3 
51.6 
28.6 


70.1 
21.0 
52.2 
87.9 
59.0 
23.1 


Primary Subpopulation Served 
Victim of spouse 

abuse 
Recovering drug/ 

alcohol abuse 
Limited English 
Other 


(n = 1077) 


(n = 1262) 


(n = 512) 


10.6 

61.3 
.2 
27.9 


9.4 

28.3 
2.6 
61.9 


.8 

19.4 
3.9 
75.9 



The educational levels of staff varied across instnictional settings as weU. Clients in non- 
residential sites were more likely to em:oU in sites where the average educational level of the staff 
was higher — 54 percent were in sites where the average staff member had at least 4 years of 
postsecondary education. Across all three settings, only about 10 peix:ent of clients enroUed in 
sites in which the average staff member had two years or less postsecondary education. 

Staff members were asked to identify the primary population that was served at that site. 
At compulsory sites, a greater proportion of clients were enrolled in sites that identified their 
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primary cUentele as recovering from drug/alcohol abuse (61.3 percent) than either voluntary (28.3 
percent) or non-residential sites (19.4 percent). In addition, cUents at compulsory and voluntary 
sites were more likely to be enrolled in sites serving victims of spousal abuse (10.6 and 9.4 
percent, respectively) than clients at non-residential sites (0.8 percent). 
CliRnt Characteristics and Pa rticipation 

In addition to differences in site characteristics across types of sites, the characteristics of 
cUents served in the three settings also varied. Table Vffl-2 summarizes tiiese differences. 

Generally, education level at enroUment and level of prior education wei-e similar across 
the three sites, witii tiie exception of individuals witii 11-12 years of prior education. A higher 
percentage of mdividuals witii 11-12 years of prior education enrolled at compulsory sites (44.3 
percent) tiian voluntary (38.7 percent) or non-residential sites (37.2 percent). 
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Table VIII-2 



Percent of Clients with Various Characteristics by Compulsory, Voluntary, 

and Non-Residential Sites 





Residential ; 






Compnlsory 


Vctfuntaiy 


Non-Residential 


Client Characteristics 


(percent of clients) 


(percent ^dittits) 


percent of dients) 


Prior Education 
Fewer than 6 years 
6-8 years 
9-10 years 
11-12 years 
12 or more 


(n = 1078) 


(n = 1276) 


(n = 529) 


1.9 
11.4 
25.3 
44.3 
17.1 


3.4 . 
12.1 
26.1 
38.7 
19.7 


4.3 
14.2 
28.2 
37.2 
16.1 


Education Level at 
Enrollment 

Level I 

Level n 


(n = 1078) 


(n = 1276) 


(n = 529) 


43.6 
56.4 


44.2 
55.8 


46.8 
53.2 


Employment Status at 
Enrollment 

Employed full-time 

Employed PT 

Unemployed 


(n = 1078) 


(n = 1276) 


(n = 5291 


4.6 
8.8 
86.6 


6.7 
7.2 
86.2 


5.3 
10.3 
84.4 




(n = 1070) 


(n = 1273) 


(n = 528) 


Sex 
Male 
Female 


59.8 
40.2 


50.4 
49.6 


57.2 
42.8 
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Table VIII-2 



Percent of Clients with Various Characteristics by Compulsory, Voluntary, 

and Non-Residential Sites 
(Continued) 





Residoitiai 






Compulsory 


Voluntary 


Non»ResidentiaI 


Oient Characteristics 


(percent of clients) 


^roHit ftf clients) 


(percent of dients) 




(n = 1077) 


(n = 1276) 


(n = 529) 


Participation in 
Educational Programs 
GED 

Adult Secondary 

Education 
Adult Basic Education 
ESL 

Employability 
Life Skills 
Self-esteem 
Other 


21.8 

3.2 
51.1 

3.5 
38.8 
87.3 
53.1 

9.7 


29.9 

8.4 
35.6 

4.7 
31.0 
80.9 
37.2 
11.3 


31.0 

9.4 

10.0 
26.8 
82.0 
41.6 
13.4 




(n = 1057) 


(n = 1190) 


(n = 499) 


Age 
16-24 
25-44 
45-59 
60+ 


22.9 
65.4 
10.8 
.9 


28.5 
61.3 
8.9 
1.3 


33.3 
56.3 
9.2 
1.2 




(n = 342) 


(n = 562) 


(n = 222) 


Number of Months 
Unemployed 

<3 

>3 


39.2 
60.9 


27.9 
72.1 


26.6 
73.5 




(n = 513) 


(n = 787) 


(n = 290) 


Number of Months 
Homeless 

< 1 

2-5 

>6 


49.5 
21.8 
28.7 


39.5 
32.3 
28.3 


24.1 
37.6 
38.3 
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A higher percentage of women enrolled at voluntary residential sites (49.5 percent) than 
compulsory residential sites (40.2 percent). The sample size is not large enough to distinguish the 
^parent differences between the non-residential sites and the other two types of sites from chance 
fluctuation. 

The number of months clients were unemployed varied across sites. The percentage of 
clients unemployed for 3 months or less was significantly higher at compulsory sites (39.2 
percent) than either voluntary (27.9 percent) or non-residential sites (26.6 percent). Similarly, the 
number of months that clients were homeless varied across the three instructional settings. The 
percent of clients who were homeless for less than cne month was higher in both types of 
residential sites than in non-residential sites. However, mdividuals who were homeless for one 
month or less were significantly more likely to enroU in a residential-compulsory site (38 percent) 
tlian voluntary-residential sites (27.9 percent); and least likely to enroll in non-residential sites 
(18.6 percent). These findings suggest that the clientele served by compulsory residential sites 
have been removed from the mainstream of society for less time than cUents served at other types 
of sites. 

Participation in educational programs differed across the three sites. Firit, a higher 
percentage of clients enrolled in non-residential sites (31 percent) participated in GED programs 
compared to compulsory sites (21.8 percent). Few differences existed between non-residential 
and voluntary sites in terms of GED participation. Second, the compulsory sites had a higher 
percentage of clients enrolled in life skills (87.3 percent) than either voluntary (80.9 percent) or 
non-residential sites (82 percent). Third, a significantly higher percentage of clients in 
compulsory sites (51.1 percent) enrolled in Adult Basic Education thai* individuals enrolled at 
voluntary (35.6 percent) or non-resident sites (36.5 percent). 
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These findings suggest distinct differences across types of programs, including differences 
in the types of clients served, the settings in which they are served, and the services available to 
them. These sorts of differences aapss types of sites must be statistically controlled if the final 
analysis is to yield a fair comparison of the types of sites and modes of instruction. 
Client Partidpation 

Clients must participate in AEH instruction if the program is to effect them. Clients who 
do not receive enough instruction will not leam from the program. This section begins by 
addressing the question: how much instruction to AEH participants receive. Once this descriptive 
baseline is estabUshed, we proceed to investigate the factors influencing the amount of instruction 

that clients receive. 

Hnw Much Instruction Do Clients Receive? 

On first glance it appears that clients receive an average of between 33 and 45 hours of 
instruction (See Table Vin-3). Individuals enrolled in compulsory sites received the fewest hours 
of instruction while individuals at non-residential sites had the most. The differences in Uie 
amount of individual instiiiction between compulsory and non-residential sites is especially large 
— clients at compulsory sites received an average of 12.1 hours, compared to 19.8 hours at non- 
residential sites. On average, individuals enrolled at non-residential sites (44.5 hours) received 
nearly 9 hours more total instruction than individuals at either voluntary (35.1 hours) or 
compulsory (33.0 hours) sites. 
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Table VIII-3 

Unadjusted Average Number of Hours of Instruction by Site 





Residential 




Uiudijasted 


Ck>mpii]soiy 


; Volant^ 


Non-Residoitial 


Indixddualized 


12.1 


(624) 


15.1 


(775) 


19.8 (372) 


Small Group 


20.5 


(648) 


24.1 


(648) 


24.5 (269) 


Total Hours 


33.0 


(903) 


35.1 


(1118) 


44.5 (487) 



NOTE: Number of valid cases for each sample is presented in parentheses. 

Only those cases with hours of instruction per day less than 10 were included in the 
analyses. 

Only those individuals receiving some instruction were included in the analysis. 

These raw figures, however, teU only part of the story. Our study covered only a three 
month period. Individuals enrolled beyond the end of the three month study period received more 
hours of instruction than we observed. We know only that they received at least as many hours 
of instruction as reported on our survey. This fact could have a substantial effect, because nearly 
one-Uiird of the clients remained enrolled at the end of the stady. 

Figure Vm-1 presents Uie percent of clients still enrolled at tiie end of tiie study period. 
Over one-quarter of tiie clients were still enroUed at the end of tiie study period at each type of 
site, witii nearly two in five clients still enrolled in non-residential sites (41 percent) and voluntary 
sites (38 percent). Compulsory sites had tiie fewest number of cUents continue tiieir enrollment 
(28 percent). 

These figures suggest tiiat tiie raw uata understate tiie disparity in tiie hours of instruction 
received at compulsory sites and otiier types of sites. Clients at compulsory sites not only 
received tiie fewest hours of instiiiction during tiie stady period, tiiey were aiso tiie least likely to 
continue enroUment beyond it. However, compulsory sites may identify clients severance from 
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the program more reliably than non-compulsory sites. The compulsory sites had probably 
implemented mechanisnois to track attendance and enrollment before this study began — they need 
it to compel students to attend. Non*compukory sites had no such requirements. Under the best 
of circumstances, it is difficult to identify dropouts. In programs for the homeless where 
attendance is voluntary, identifying the point at which clients terminate thek participation is 
virtually impossible. 

With this caution, we present adjusted estimates of the number of hours of instruction that 
clients receive, adjusting for those clients still enrolled. Statistical methods are available to make 
these estimates when the data are censored, that is, when some students are still enrolled at the 




end of the study period. By specifymg a sufficiently flexible distribution function (e.g., a WeibuU 
distribution), we can fit it to the data using maximum likelihood estimation even in the presence 
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of censored data. Thus, we can compare estimated averages of hours and days of instruction that 
are not biased by censoring. See Appendix D for details of the statistical framework. 

Table Vin-4 presents the results of this analysis. Overall, the g^ between the total hours 
of instruction received at residential and non*residential sites widens when adjustments are made 
for students still enrolled at the end of the study period. Students at non*residential sites receive 
an average of about 54 hours of instruction, while students at both types of residential sites 
receive just under 40 hours of instruction. Among those clients receiving individual instruction, 
clients at compulsory residential sites received far fewer hours than clients at non-residential sites. 

Clients at compulsory residential sites receive not only fewer hours of instruction, they 

* 

receive fewer hours of individual instruction. The actual differences in hours received are greater 
than apparent in the descriptive analysis when one takes into account clients still enrolled at the 
end of the study period. 



Table VHM 

Adjusted Average Number of Hours of Instruction by Site 



Adjusted 


Residential 


Non-Residential 


CiHnpiilsoiy 


Voluntary 


Individualized 


14.6 (623) 


23.1 (775) 


25.7 (372) 


Small Group 


23.8 (647) 


33.7 (648) 


36.8 (269) 


Total Hours 


37.1 (902) 


39.9 (1118) 


54.2 (487) 



NOTE: Number of valid cases for each ;ample is presented in parentheses. 

Only those cases with some instruction, but reporting fewer than 10 hours of instruction 
per day were included in the analyses. 



At all types of sites, most students who receive small group also receive individual 
instruction. However, the mix of different types of instruction received by individual students is 
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not identical across sites. The amount of each type of instruction received was correlated in each 
type of site, though the strength of these correlations varied across types of sites. Table VIII-5 
presents these figures. 



Table VIII-5 

Relationship Between Individual and Small Group Instruction 





Residential sites 


Non^Residential 


Compiilsory : 


Tdlimtary 


Percent of clients receiving 
snaall group instruction 
who also receive 
individual instruction 


72.2% 


76.9 


78.4 


Correlation between hours 
of individual instruction 
and hours of small group 
instruction 


.47 


.27 


.16 



1 

p 
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The correlations indicate that the clients who receive the most small group instruction also 
receive the most individual instniction. This relationship is strongest at the compulsory sites. At 
the other sites,^ and the non-residential sites in particular, this relationship is much more tentative. 
This suggests that the mix of small group and individual instniction is more variable at both non- 
residential and voluntary residential sites. 

In summary non-residential sites provide a greater number of total hours of instruction and 
a greater number of both individualized and small group instruction. This finding occurs when 
the data are both adjusted and unadjusted for censoring. Clients who receive individual 
instruction also tend to receive small group instruction. The relationship between the amount of 
individual and small group instruction received varies across different types of sites. 
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These findings challenge the accepted wisdom in the field. Principal instnictors 
responding to our survey thought that clients at residential sites would receive more instruction, 
and that clients at compulsory-residential sites would participate even more. A simple comparison 
of absolute levels of participation, however suggests that this is not the case. On the contrary, 
participation is highest at non-residential sites and lowest at compulsory residential sites. 

It is possible that the different amounts of intervention that clients receive at different 
types of suites is only spuriously related to the residential or compulsory nature of the sites. As is 
clear from the comparison of differences across types of sites in the preceding section, differences 
in the types of sites (residential-voluntary, residential-compulsory, or non-residential) are 
associated with other site characteristics and tend to be attended by clients with somewhat 
different characteristics. The following section uses multivariate methods to sort out the effects of 
the various characteristics. 

Factors Influencing Client Partidpation 

When multivariate statistics hold cross-site differences constant, they tell a somewhat 
different story than the descriptive statistics. The instructional setting (residential-<:ompulsory, 
residential voluntary, and non-residential) is shown to be unrelated to client persistence. The 
differences apparent in the bivariate tables are largely attributable to the differences in the 
student/staff ratios across instructional settings. 

These results emerge from a survival analysis of the number of hours of instruction 
received by AEH clients. Survival analysis refers to regression methods used to analyze the 
amount of time people (or whatever unit of analysis) spend in a particular state (in this case, 
attending AEH programs). These models prove particularly useful for censored data, that is, data 
which measure only part of the total amount of instruction. In this case, about one third of all 
clients for whom we have data were still enrolled when our study period ended. Therefore, we do 
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not actually know the total number of hours that they would ultimately receive, except that they 
had akeady received at least as many hours as observed. 

For this analysis, we treated the measured hours of instruction as incomplete (censored) 
under three conditions: 

• The client was still enrolled at the end of the study period; 

• The client left the program because they found employment or because they met their 
educational objective (in this case it is not clear that further persistence is a desirable 
outcome and we don't know how long they would have participated had they not 
found employment); or 

• The client was forced to leave the program (in this case we do not know how long the 
client would nave chosen to stay had he or she not been forced from the program). 

The multivariate model described in details in Appendix D, controlled for: 

• Individual characteristics inclu(,ing gender, age, previous educ^ot^al level, 
employment status, and duration of homelessness; 

• Site characteristics in addition to the residential or compulsory nature of the program 
including urbanicity, the proportion of staff with a college degree, and the primary 
population served; and 

• Client program participation, including whether they took part in academic (ABE, 
ASE, or GED program), lifeskills programs, or ESL programs. 

Table VIII-6 presents key results from this analysis (Appendix D contains complete 

regression results). The figures in Table Vin-6 are elasticities, that is, they represent the percent 

change in the expected hours of instruction associated with a percent change in the explanatory 

variable. The reason for preferring a model of this type (rather than a linear model in which, ior 

example, a year change in age is associated with jc hours more instruction) is the wide range in 

hours of instmction received. For example, suppose we opt for a linear model and an extra year 

of age is associated with an extra 0.4 hours of instmction. Now, suppose we have two students, 

one whose characteristics (other than age) suggest that he will remain enrolled for 10 hours of 

instruction, and one whose characteristics suggest that she will remain enrolled for 80 hours. A 
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10 year age difference would suggest a four hour change in the amount of instruction received — 
this is a substantial effect for the first student, and a trivial effect for the second. However, some 
factors have a **big** effect on people whose characteristics put them at both ends of the spectrum. 
Therefore, a model which yields elasticities is preferable. 

As an example of how to read the table, consider the client*s age. Table VIII-6 presents 
an elasticity of 0.40, implying that a one percent change in a client*s age is associated with 0.4 
percent change in the number of hours of instmction, other things being equal. Of course some 
variables represent categories (such as residential versus non-residential). In these cases, the 
elasticity represents the percent change in the expected hours of instmction associated with 
membership in that category. Consider the client's prior educational level as an example of a 
categorical variable (the variable indicates whether the client entered the program at Level II). 
The estimate presented in Table Vin-6 is 0.49, suggesting that clients entering at Level n receive 
49 percent more hours of instruction than similar clients who had attained only Level I skills by 
the time they enrolled. 

When student characteristics, participation in instmctional programs, and other site 
characteristics are held constant, students persistence is similar across all three types of sites. 
That is, residential and compulsory settings have no bearing on hours of instruction received by 
clients. Other site characteristics, however, exercise a substantial influence. 

Sites with higher smdent/staff ratios retain students for fewer hours of instmction. Other 
things held equal, a ten percent increase in the number of students per staff member is associated 
with about a 2.9 percent drop in the expected hours of instmction that students receive. Sites in 
which a higher percentage of staff members have college degrees increase student retention about 
1.7 percent for every 10 percent increase in the proportion of college degrees.^ 

^ The elasticity represents the instantaneous change, so the percent changes actually 
compound. The compounding leads to an estimate somewhat more than IJ percent, 
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Table Vni-6 



Percentage Change in the Expected Hours of Instructkon Associated With 
Selected Characteristic of the Instructional Setting 



€3iaracteristics of Instructional Setting 


Elasticity 


t 


Site Characteristics 








-.386 


Compulsory (versus non-compulsory) 


NS 


.464 


Student/instructor ratio 


-.29 


-5.31 


Proportion of staff with a college degree 


.17 


2.02 


Primarily serving people with drug or alcohol abuse problems (versus 
all other primary clienteles) 


.76 


4.72 


Primarily serving victims of spouse abuse (versus all other primary 
clienteles) 


-.29 


-2.20 


Rural site (versus suburban) 


1.00 


3.70 


Urban (versus subiuban site) 


.38 


3.00 


Client Participation 


Percent of time spent in small group instruction (if available) 


-.35 


■4.28 


Percent of time spent in individual instruction (if available) 


-.51 


-8.02 


Distribution of instructional time unavailable 


1.36 


6.33 


Enrolled in GED, ABE or ASE program (versus not) 


1.83 


9.40 


Enrolled in lifeskills program (versus not) 


1.89 


8.64 


Enrolled in ESL program (versus not) 


1.63 


3.92 


Client Characteristics 


Client's age 


.40 


2.53 


Entered at Levid n (versus Level I) 


.49 


4.00 


Duration of hom^^itlessness (if available) 


.12 


2.15 


Duration of homeless.'^ess unavailable 


-.45 


-3.96 



NOTES: 'j^t^lSOSnncluSi^ hour of instruction 



2. dependent variable: total hours of instruction (client questionnaire item 14) 

3. Except for residential and compulsory status, only variables associated with significant 
parameters are listed in the table. 

4. NS = not statistically significant atp < .05. 
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Recall from the initial analysis of differences across types of sites that compulsory sites 
tended to have much higher student/staff ratios. This fact goes a long way in explaining why the 
initial tables comparing the hours of instruction received across sites showed clients at compulsory 
sites receiving fewer hours of instruction: Clients in sites with high student/staff ratios tend to 
receive less instruction. 

A second factor that contributes to the observed difference in the amount of instruction 
received across site types is their geographic distribution. Rural sites have the longest retention, 
followed by urban sites. Sites in smaller cities or towns, or in suburbs categories have the 
shortest retention. Compulsory sites are the least likely to be located in rural areas. 

The effects of geographic location and student/staff rario at compulsory sites are somewhat 
offset because people recovering from drug and alcohol abuse, often the primary clientele at 
compulsory sites, tend to receive more hours of instruction. On the other hand, clients at sites 
serving victims of spouse abuse (which are a larger proportion of the clients at residential- 
voluntary and residentialH:ompulsory sites than non-residential sites) tend to leave sooner, 
receiving almost 30 percent fewer hours of instmction. 

This analysis found no difference in persistence between residential and non-residential 
sites. Clients at residential and non-residential sites received about the same amount of instruction 
as would be expected, given their characteristics and the other characteristics of the site that they 
were attending. This contradicts the beliefs of instmctors at the sites, who though that clients 
received more instruction at residential sites. One possible explanation for this, though our 
cannot address the issue, could be differing levels of client motivation. Clients who do not attend 
residential sites face greater barriers to enrollment and attendance than do clients at residential 
sites. These additional barriers may weed out the less motivated clients at non-residential sites, 
leaving a pool of more motivated individuals than is found at residential sites. This greater 




motivation may lead to better attendance and longer persistence than is found among the 
(presumably) less motivated clients at residential sites. 

Turning our attention to tiie student's program participation, we find a few substantial 
results. Students enrolled in academic-oriented programs tend to persist substantially longer than 
those who are not. In fact, tiieir average tenure is 183 percent longer. Similar retention 
improvements are apparent among tiiose who are enrolled m ESL and life-skills programs. 

For tiiose smdents for whom we know some of tiie details of how tiiey spent their time, 
we find tiiat tiiose who spent a greater proportion of time in individual instiuction or in small 
group instruction tended to receive fewer hours of instruction. These findmgs suggest tiiat some 
otiier form of instruction may be more conducive to persistence. However, our survey did not 
collect detailed information about tiie amount of time tiiat students spent in all types of 
instiiiction. Otiier analyses (not reported here) suggest tiiat clients at sites tiiat offer peer 
instiTiction tend to receive more hours of instruction. However, tiie survey reports only tiiat tiie 
site offers such instiiiction, and does not provide information about tiie extent to which individual 
students participated in such mstruction. Thus, subsequent studies will be needed to determine tiie 
types of instiiiction tiiat are tiie most conducive to student retention.^ 

Students' individual characteristics also influence tiieir tenure in tiiese programs. Older 
clients tend to stay longer and receive more hours of mstiiiction. Those entering witii Level n 
skills remain longer tiian tiiose witiiout tiiem, and tiiose who have been homeless longer also tend 
to stay longest. Those for whom tiie duration of homelessness was not available were likely to 
leave much sooner. 



^ We note tiiat students for whom information about small group or individual instinction is 
not available tended to persist longer. 
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Academic Improvement 

The bottom line in any educational program is whether students leam. The scope of this 
study limits the amount of information available upon which to base this judgement, but some 
indicators are available. The two most direct indicators are 1) a general judgement of academic 
improvement rendered by program staff for all clients; and 2) staff reports regarding whether 
clients received a GED certificate, which is applicable only to clients pursuing the GED. Below, 
we examine factors influencing each outcome measure. Because the reported improvement 
measure is applicable to a much larger number of clients, estimated influences on this outcome are 
much more precise. 

Reported Improvement 

Staff at participating sites were asked to identify the academic skill level of clients upon 
entering and leaving the program, or at the end of the study (for those still enrolled). At the end 
of the study staff members recoded whether clients moved from Level I to Level II, or moved up 
within these levels. All of these outcomes were consideifed "academic improvement" for the 
purpose of this analysis. 

Readers should be aware that this measure of unprovement is subject to substantial 
measurement error, and perhaps bias. Makers of standardized tests for adult education students 
concede that thek tests are not sensitive enough to measure improvement in students who have 
received fewer than 70 hours of instruction. However, few of the students in these classes have 
received that level of instmction. Nonetheless, respondents indicated that over half of the clients 
had improved. Therefore, this measure rests on the assumption that site personnel are more 
sensitive to student improvement than are standardized tests. 

Estimates from a multivariate analysis suggest that individual instmction is vastly superior 
to small group instmction, though small group instmction appears quite effective in compulsory. 
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residential sites. We speculate that this may foUow from more regular attendance at these sites - 
it is easier to teach a group when the group is comprised of a similar set of students in each class. 
Another finding that confirms beliefs within the field is that high sUidentAeacher ratios impede 
learning. This finding is particularly interesting because it holds true even when we control for 
tile number of hours of individual Lnstruction received. 

The statistical model underlying tiiese findings included all of die information included in 
tiie model of hours of instruction received, along wifli measures of tiie amount of individual and 
small group instruction received by each student for whom tiiat information is available. Finally, 
tiie model included terms to capture tiie differential effect of hours of individual and small group 
instruction at compulsory sites. Interested readers can refer to Appendix E for tiie technical 
details of this analysis. 

The significant findings fi:om tius analysis are summarized in Table Vin-7. The statistical 
technique used is called probit, and is not a simple linear model. The estimated effect of each 
factor varies with tiie levels of tiie otiier variables in tiie model. In oider to provide an intuitive 
feel for tiie magnitude of tiie estimated effect of each factor. Table Vni-7 reports tiie predicted 
probability of improvement for an average student at an average site, witii tiie exception of tiie 
trait listed in tiie row heading, which takes on tiie value identified tiiere. This lets us observe tiie 
effect of varying one factor while holding all otiier factors constant. 

Here, we find tiiat client perfonnance at residential sites is no better tiian at non-residential 
sites. Similarly, clients at compulsory sites are no more or less likely to improve when otiier 
factors are statistically controlled. 

Two findings stand out in Table Vin-7: tiie large effect of individual instmction 
regardless of instnictional setting and tiie striking impact of small group instiuction at compulsory 
sites. An average student at a non-compulsory site receiving 10 hours of individualized 
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Table VIII-7 

Estimated Probability of Improvement for an Average Student at an 
Average Site, Varying One Trait at a Time 



H)poUieticaI stiiulrat diai«:teristi 


improvemlmt iniskiU^^te^^ 


Average 


.56 


Site Characteristics 


Compulsory 


NS 


Residential (versus non-residential) 


NS 


Voluntary residential 


NS 


Urban 


.62 


Rural 


.46 


Suburban/small city 


.54 


Serving primarily people with alcohol problems 


.52 


Serving other populations 


.59 


Student Participation 


0 hours individual instruction at non-compulsory site 


.44 


10 hours individual mstruction at non-compulsory site 


.55 


25 hours individual instruction at non-compuisory site 


.71 


50 hours individual instruction at non-compulsory site 


.89 


0 hours individual instruction at compulsory site** 


.45 


10 hours individual instruction at compulsory site** 


.63 


25 hours individual instruction at compulsory site** 


.85 


50 hours individual instruction at compulsory site** 


.98 


0 hours small group instruction at non-compulsory site 


.57 


10 hours small group instruction at non-compulsory site 


.57 


25 hours small group instruction at non-compulsory site 


.57 


50 hours small group instruction at non-compulsory site 


.57 


0 hours small group instniction at compulsory site 


.59 
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Table VHI-T 

Estimated ProbabUity of Improvement for an Average Student at an 
Average Site, Varying One Trait at a Time 
(Continued) 



Hjrpothetical stadrat charactenstiGs (av6rag6 - cxcepi for . = 
trait identified) 


improvonent In skill level 


10 hours small group instruction at compulsory site 


.64 


25 hours small group instruction at compulsory site 


.71 


SO hours small group instruction at compulsory site 


.80 


Not enrolled in ABE, ASE, or GED program 


.27 


Enrolled in ABE, ASE. or GED program 


.73 


Not enrolled in life skills program 


.33 


Enrolled in life skills program 


.61 


Not enrolled in ESL program 


.55 


Enrolled in ESL program 


.74 


Student Characteristics 


Entered with Level 1 skills 


.48 


Entered with Level 2 skills 


.63 


Entered with 12 years of education 


.60 


Entered with fewer than 12 years of education 


.49 



NOTES: n^l533. See Appendix E for details 

NS - no significant difference atp < .05 

not significantly different than non-compulsory sites 



instruction has about a 55 percent chance of improving. With 50 hours of individual instruction 
this same student has an 89 percent chance of improvement. This impact is substantial, though 
not unexpected. 

The estimated effects of small group insuuction call for more attention. The effect is 
virtually zero at non-compulsory sites once the individual instruction and other types of instmction 
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are taken into account. However, at compulsorj' sites sniall group instruction is strongly related to 
learning. At compulsory sites, an average student receiving an average amount of other types 
instruction and no small group instruction has a 59 percent chance of improvement. The same 
student receiving 25 hours of small group instruction increases his or her odds of improvement to 
71 percent. When the amount of small group instruction reaches 50 hours, the odds of 
improvement reach 80 percent. While this effect remains somewhat smaller than the estimated 
effect of individual instruction, it is much higher than is apparent at non-compulsory sites. It is 
possible that the better attendance mandated by the compulsory sites makes group instraction a 
more realistic option. Instructors can better plan and implement lessons when die same students 
show up for class each week. 

A few other findings warrant mention. Students at sites serving primarily recovering 
alcoholics and drug abusers tend to perform slightly worse than clients at other types of sites. 
Students in rural sites also have a slightly lower probability of improvement. Students who enter 
with Level n skills are more likely to improve than students entering with Level I skills. 
Somewhat surprisingly, clients who have completed at least 12 years of school prior to enroUment 
have a lower probability cf improvement. 

Finally, students enrolled in academic (i.e., ABE, ASE, or GED), lifeskills, and ESL 
programs tended to outperform their peers who were not enrolled in these programs. The 
relationship of improvement with enrollment in academic programs seems quite reasonable. After 
all, the "improvement" measure seeks to measure improvement in basic academic skills. The 
apparent effect of lifeskills programs poses somewhat more of a mystery. While these programs 
may help clients adjust to the demands of an educational environment, it is also possible that the 
students enrolled in lifeskills programs differ from those who are not. Given that the vast 
majority of AEH clients study lifeskills, investigation into this issue should begin by examining 
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differences between this majority and the minority that does not study lifeskills. Finally, ESL 
clients are more likely to improve than non-ESL clients, other things being equal. 
GED Certificates 

The survey provides another measure of academic improvement that is relevant to a small 
subset of the clients served: whether or not the sampled clients received their GED certificate. 
Of course, in this population few clients pursue the GED certificate within three months of 
entering the program. In this sample, 27 percent (804 clients) were enrolled in GED programs. 
Of these information about GED completion was unavailable on 254 clients. Of the remaining 
550 clients, 93 (17 percent) received a GED certificate. 

Readers should be aware that the large amount of missmg data for this outcome raises the 
possibility that the reported information is not a representative sample of aU GED attempts. In 
addition, results from the small sample are less precise than results based upon the full sample of 
clients. 

For these reasons, the results of this analysis should be taken tentatively. Still, the 
findings from this analysis suggest some interesting relationships. Predictably, more hours of 
instmction arc associated with a greater probability of receiving a GED, as is a higher educational 
level at entry. Women are less likely to receive a GED than men, though victims of spouse abuse 
(primarily women) are more to do so. Finally, the results inconclusively suggest that students at 
residential programs are less likely to receive a GED tjian students at non-residential sites, though 
this finding is not statistically significant at the customary (0.05) level. 

Table Vin-8 presents the results from this analysis. Once again, the probit model 
provided these results. Following the format set forth in Table Vin-7, tlie table presents the 
estimated probability of completing the GED certificate for a student who is average in all ways 
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Table VIII-8 



Estimated Probability of Attaining a GED Certificate of a Student Who is 
Average in All Traits Except the One Listed in the Row Heading 



Oiuacteristic 


Prbbability of 
ceirtifidite 


Site Characteristics 


Residential* 


.09 


Non-iesidential* 


.18 


Serving primarily victims of spouse abuse 


.28 


Serving other populations 


.12 


Student Participation 


0 total hours of instruction 


.09 


10 total hours of instruction 


.10 


25 total hours of instruction 


.11 


SO total hours of instruction 


.22 


Client Characteristics 


Male 


.18 


Female 


.08 


Level 1 


.03 


Level 2 


.22 



NOTE: * The difference between residential and non-residential sites is not statistically 
significant at the traditional .05 level (p^.06l 

except the trait identified in the row heading. For this presentation, ''average'' was taken to be the 
average for all students enrolled in a GED course. 

Clients at compulsory sites were no more likely to receive a GED than clients at other 
sites when other factors were statistically controlled. The results are inconclusive regarding the 
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relationship between attaining a GED and attending a residential site. Clients at non-residential 
sites may be more likely to earn a GED certificate than clients at non-residential sites. The 
probability that this is due to chance rather than a systematic relationship is higher than is 
typically accepted. Thus, this finding must remain inconclusive. 

The sample was not large enough to detect differences in the effect of the various modes 
of insttuction, but we can safely reject the null hypothesis that hours of instruction are unrelated 
to the probability of receiving a GED certificate.^ An average student enrolled in a GED 
program has an estimated nine percent chance of receiving the certificate within three months. 
With 50 hours of instruction this probability grows substantially, to 22 percent. 

A few client characteristics were also related to the probability that clients would receive 
their GED. Men are more likely to receive the GED certificate than women, other things being 
equal. Predictably, students entering with Level I skills have only a three percent chance of 
receiving their GED in three months, while those entering with Level H skills have a 22 percent 
chance of success. 
Summary 

A few findings spring clearly from this analysis. First, the student/staff ratio in AEH 
programs matters — students in programs with high ratios take fewer hours of instniction, and are 
less likely to show academic improvement. Second, individual instniction is a powerful 
instnictional strategy, and shows consistent, strong relationships with acadenoic improvement. 
Other instnictional strategies which we did not study in detail (e.g., peer instniction) however, 
may be more conducive to client persistence. 



' The sum of the effects of the different hours of instruction is significantly above zero 
(X^(l) - 4.24, p « .039), and is not statistically different tiien tiie total hours for tiiose for whom 
Uie breakdown was unavailable (x^d) - 2.68, p - .10). The figure reported in tiie table is for 
total hours for tiiose for whom a breakdown into individual and group instruction is not available. 
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Third, small group instruction is most effective in compulsory-residential sites. We 
speculate that compulsory sites have more regular attendance, enabling teachers to develop and 
implement lesson plans ^propriate for group instruction. Finally, clients enrolled in more 
academically oriented programs (ABE, ASE, or GED) tend to receive more hours of instruction 
and have a greater probability of showing improvement. 

These analyses did not provide any evidence of two effects that AEH instructors believed 
to exist: 

• Contrary to instructors' expectations, clients at residential sites performed no better 
than clients at non-residential sites; and, 

• Contrary to instructors' expectations, clients at compulsory sites received no more 
hours of instruction than clients at non-compulsory sites, and fared no worse 
academically. 

None of our analyses suggested that clients at residential sites performed any better than 
clients at non-residential sites. Instructors believed, however, that by providing shelter the 
residential sites removed some considerable barriers to learning that clients might otherwise face. 
This reasoning neglects the possibility that clients at non-residential sites may be more motivated 
than clients at residential sites. Homeless people who attend a non-residential education centner 
often overcome substantial barriers to enroll in these programs. They must locate the programs, 
arrange transportation, and make their way to the site to enroll. Less motivated individuals are 
less likely to make this effort. Clients at residential sites face none of these barriers. They 
simply wake up on site. Indeed, their participation may be a side-effect of seeking shelter. 
Therefore, the pool of individuals attending non-residential sites may be more motivated that those 
attendmg residential sites. Of course, collecting data that would bear upon the motivation of 
individual clients was well beyond the scope of this study. However, such an inquiry may prove 
valuable. 
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Clients at residential-compulsory sites received no more instruction than clients at non- 
compulsory sites, again defying the expectations of instmctors. Indeed, simple bivariate analysis 
suggested that clients at compulsory sites received less instruction than others. However, 
multivariate analysis showed that this relationship was spurious, driven largely by the fact that 
compulsory sites were more likely to have high ratios of students to staff. High student/teacher 
ratios are not conducive to persistence. 

On the other hand, client at compulsory sites were no less likely to show academic 
improvement than clients at non-compulsory sites. This was partly attributable to the fact that 
small group instruction proved much more effective in compulsory settings than where attendance 
was voluntary. We speculate that more consistent attendance allows teachers to better plan and 
implemei.t lessons. 



CHAPTER IX 
CONCLUSIONS AND EVALUATION GUIDELINES 



Overview 

■ Over the past decade, homelessness has emerged as a persistent and pernicious social 

■ problem in the United States, and, according to the reports of most observers, its dimensions 
continue to grow. Initially, homelessness was perceived to be a short-term emergency requiring 

■ short-term solutions, and early efforts to address the problem focused on the provision of food, 

■ clothing, and temporary shelter to those in need. More recently, policymakers have begun to 
recognize that homelessness is, in fact, a d^^'^p-rooted socioeconomic problem that must be 

■ combated through policies that deal with its underlying causes as well as its more visible effects. 

■ The Stewart B. McKinney Homeless Assistance Act of 1987 represents the first piece of 
Federal legislation to acknowledge the multi-faceted nature of homelessness and to address the 

■ issue in a more comprehensive manner. The AduU Education for the Homeless (AEH) Program, 

■ the first Federal initiative aimed specifically at the educational needs of the homeless, represents 
one of the many programs authorized by the McKinney Act. Administered by the U.S. 

■ Department of Education, the AEH program provides literacy trsining and basic skills remediation 

■ to thousands of homeless men and women across the United States each year. 

This study offers the first comprehensive review of the AEH program, reporting on its 

■ organizational structure, the clients that it serves, and the educational programs that it provides. A 

■ complete review of the study's principal findings is presented in the Executive Summary of this 
report. Here our goal k: (1) to provide an integrated summary of selected findings as they relate 

I to several broad areas of concern to program administrators, policymakers, and adult educators, 

■ and (2) to provide guidelines that states may use in evaluating the AEH program in the future. 

r o 
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Integrated Review of Findings 

In this initial section, various findings of this report are summarized in the context of three 
broad areas: (1) the capacity of the AEH program to fulfill its mission of providing literacy 
training and adult basic education to the homeless; (2) the context in which educational services 
are provided; and (3) the practices employed in the delivery of educational services. 
Program Capacity 

Since its inception, in 1987, the AEH program has provided adult literacy training and 
basic skiUs remediation to more than 150,000 clients, including nearly 50,000 in 1992 alone. The 
program funded projects in 35 states in 1992 which, in tum, provided support to nearly 300 local 
programs. In its first five years, the program has nearly tripled its services to homeless adults, 
while Federal appropriations have increased only marginally. This has placed significant strain on 
the capacity of the program to meet the needs of the growing number of homeless individuals it 
serves. 

Not surprisingly, the vast majority of project administrators cite problems related to 
funding as the principal challenge that they face. In some states, this challenge has been at least 
partially overcome by supplementing Federal grant money with funds from other sources. About 
1 in 3 AEH projects receives supplementary Adult Education Aa funds and 1 in 10 receives 
supplementary state and/or JOBS funds. Approximately two in Hve local programs also receive 
external support from various sources. Finally, all states rely heavily upon volunteers who help to 
meet the ever-rising demand for services. More than 1 in 10 teachers and counselors and about 7 
in 10 instructional aides volunteer their services to the program on a regular basis. 

Despite the AEH program's limited resources, the qualifications of program administrators 
and instnictional staff are remarkably high. On average, state administrators have more than IS 
years of adult education experience and about 5 years of experience working with the homeless. 




Nearly aU teachers and counselors, and more than half of all instructional aides and tutors, are 
college graduates. Three-fifths of teachers are certified in elementary/secondaiy education, one- 
third are certified in adult education, and more than a third of counselors hold state certification. 
Furthermore, all local program stafl^ have several years of experience working with homeless 
adults — about three years, in the case of teachers. 

WhUe staff qualifications are high, the present level of flmding has placed considerable 
strain on the program's capacity to maintain its current level of services. This is perhaps most 
evident in the area of curriculum development. On average, states aUocate about one-half of one 
percent of budget to curriculum development, and local programs spend even less. State 
administrators recognize tiiis deficiency and have requested technical assistance from tiie Federal 
Government in developing and dissenoinating curricula that meet tiie unique needs of the 
homeless. 

Thus far, the AEH program has met the growing demand for services each year, witii no 
apparent decline in the quality of services provided. But, as these figures suggest, any fiirther 
expansion of services may be impractical, if not impossible, given current fimding levels. 
Context of Instruction 

Two issues concerning the most appropriate context for the delivery of educational 
services to homeless adults have been highlighted tiiroughout this report. The first pertains to the 
relative eff^ectiveness of residential and non-residential sites, and tiie second concerns Uie relative 
effectiveness of compulsory and non-compulsory program structures. 

Residential vs. N on-Residential Sit^ g 

Each local program provides educational services at one or more service delivery sites. 
While more than a quarter of tiiese sites are non-residential — e.g., adult leammg centers, 
community centers, school classrooms, libraries, and churches — tiie vast majority are residential 
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locations where homeless men and women seek temporary shelter. For the most part, these 
locations consist of emergency shelters and transitional housing — about 42 and 26 percent of all 
sites, respectively. 

Although more than one-third of residential sites impose no specific maximum stay 
limitations, roughly half restrict stays to three months or less. About two in five sites permit 
longer than normal stays for residents participating in the AEH program, and, at a majority of 
these locaUons, program participants may reside on-site for an additional three months or more. 
Finally, while tiie vast majority of residential sites allow clients to continue in tiie AEH program 
after discontinuing residence, about half of tiiese sites report tiiat less tiian 10 percent of clients 
avail themselves of this opportunity. 

Administrators of local programs tiiat provide services at botii residential and non- 
residential sites suggest tiiat each approach has its advantages. According to tiieir experience, 
residential sites offer a more comprehensive system of support, better accessibility, and greater 
client participation, while non-residential settings permit greater focus on education, carry less of 
tiie stigma tiiat is sometimes associated witii programs identified witii tiie homeless, and provide 
better instructional facilities. On balance, however, tiiese administrators rate residential settings 
more effective Uian non-residential settings by nearly a two-to-one margin. 

Multivariate analyses of factors influencing tiie hours of instiiiction clients receive and 
educational outcomes provide anotiier mechanism for comparing tiie impact of residential and 
non-residential sites. These analyses revealed no differences between sites which provided 
residence and tiiose which do not, even while controlling for measured cUent characteristics and 
otiier differences across sites. However, our study was not designed to measure levels of client 
motivation, which is likely to differ between residential and non-residential sites. Clients 
attending non-residential sites must overcome many barriers to enroll: tiiey must locate tiie site. 



O 146 

ERIC 



165 



arrange transportation, and actually get there. This requires substantial effort (and hence, 
motivation) compared to clients at residential sites who may incidentally lo^iate the program in 
their search for shelter. Therefore, the cKents served at residential sites may pose a greater 
chaUenge than clients at non-residential sites because of reasons for which we were unable to 
control. 

Compulsory v s. Voiuntarv Program Stnictarcs 

TraditionaUy, participation in adult education programs has been voluntary. However, in 
the case of tiie Adult Education for the Homeless Program, about one-third of residential sites link 
the provision of shelter to participation in tiie AEH program, and, overall, about one-tiiirxl of 
cKents participate on a compulsory basis. Some contend tiiat such measures are necessary to 
overcome tiie inhibitions and self-doubts of homeless individuals, while otiiers question tiie 
educational effectiveness of tiiis approach. 

Administiators of local programs tiiat provide services at sites where participation is 
compulsory and otiiers where it is not would seem to be uniquely qualified to judge tiie relative 
merits of compulsory and voluntary program structures. The vast majority of administrators witii 
such direct comparative experience express tiie view tiiat mandatory programs result in greater 
duration and intensity of instruction. Yet, more tiian one-tiiird of tiiese same administrators (37.7 
percent) perceive clients enrolled on a compulsory basis to be less motivated tiian tiiose who 
participate voluntarily, and only one in four (26.1 percent) associate compulsory participation witii 
greater client motivation. 

When program stiuctures are compared in terms of hours of instruction and various 
program outcomes while otiier factors are statistically held constant, a slightiy different picture 
emerges. We find tiiat tiie compulsory nature of sites does not contiibute to tiie amount of 
instruction that cUents recieve. One educationally significant difference does emerge: hour for 
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hour, small group instruction is more effective at compulsory sites than at other types of sites. 
We posit that this benefit accraes because instiuaors can better plan lessons when they can expect 
leliable attendance from a consistent set of students. 

To our knowledge, only two other programs of adult literacy training involve compulsory 
participation — the JOBS program and the Federal Bureau of Prisons' Mandatory Uteracy 
Program. According to McCoUum (1993), the results of the latter program have been remarkable. 
Prisoners entering the Federal prison system without a high school diploma or a GED arc required 
to participate in a 120-day educational program designed to prepare them for the GED. Among 
those enrolling in the program, approximately 6,000 take the GED examination each year, and 
about 70 percent pass.^ Thus, despite the widely held belief that adult education must be 
voluntary in order to be effective, these two studies offer provocative evidence to the contrary. 
Further research in this area is clearly warranted. 
Instructional Practices 

Within the AEH program, a broad range of instructional practices are employed in the 
delivery of educational services. At most AEH delivery sites, several instructional approaches and 
strategies are utilized, and, therefore, instructors at these sites are in a unique position to evaluate 
the effectiveness of one approach or strategy vis-a-vis that of another. For this study, principal 
instructors at each site were asked to specify which of the various practices utilized at their site 
had proven most effective. Their aggregated responses provide a basis for comparing the relative 
effectiveness of the various practices employed. In addition, most sites record the number of 
hours of individualized and small group instruction that each client receives. A comparison of the 
relationships between various outcomes and clients' exposure to each type of instruction provides 



^ Of course, compulsory education of children has a respectable track record as well. 
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another means of assessing the relative effectiveness of these two approaches. Findings from this 
investigation are summarized below. 
Instructional Approach 

By a wide margin, individualized instruction is the most widely utiUzed approach and, 
according to tiie ratings of principal instructors, also die most effective. Indeed, multivariate 
analysis supported tiie instmctors in tiiis belief. Individual instmction proved a reKably powerful 
instructional tool. However, we also found tiiat witiiin compulsory-residential sites, small group 
instniction prnved almost as effective as individual instruction. As mentioned above, compulsory 
sites may provide instructors wiUi a more consistent set of students in each class. 

Instnictinnal Strategic 

Johnson (1985) cites the "lack of strategies, inadequate strategies, and inappropriate 
generalized strategies" as a major problem in literacy education. Unfortunately, littie empirical 
support exists for tiie effectiveness of any instructional strategy (Hayes, 1992). Client records 
rarely contain sufficient information to permit an objective evaluation of the relative effectiveness 
of various instructional strategies in relation to outcomes, but Uiis study does provide some 
insights into tiie perceived effectiveness of various strategies. Workbook-based insttuction is botii 
tiie most widely utilized strategy and, according to tiie judgment of principal instructors, tiie most 
effective, whUe cooperative learning ranks second in botii prevalence and perceived effectiveness. 
Otiier strategies - including creative writing, cneriential learning, and intergenerational learning 
— are less widely utilized and generaUy judged to be less effective. 
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Evaluation Guidelines 

Absolute and Relative Evaluations 

Three reasons for conducting formal evaluations of educational programs have been 
identified by Spanard (1990): 

• To satisfy the requirements of the funding agency that supports the program; 

• To justify what is being done; and 

• To improve or change a program. 

The first two of these objectives are generally best satisfied by conducting an absolute 
evaluation in which a program's outcomes are compared with those of a randomly selected control 
group or with a set of absolute standards. However, this approach involves several complicating 
factors which may render it infeasible. Fust, if local programs vary substantially among 
themselves and in terms of the populations that they serve, it is unlikely that a single set of 
absolute standards can be identified. Second, assigning eligible applicants to '"treatment" and "no 
treatment" control groups may meet with resistance from local administrators because of thek 
desire to provide services to all eligible applicants. Finally, even if these obstacles could be 
overcome, any evaluation conducted with the goal of pro jram justification is likely to involve a 
high degree of response bias. There is, after all, very little incentive to provide objective, 
unbiased information when a program's very survival hangs in the balance. 

The third objective of program evaluations identified by Spanard is best satisfied by 
conducting a relative evaluation, such as that suggested by Stake (1967), in which the goal is to 
highlight those practices and processes that are associated with the relative effectiveness 
programs in achieving specific outcomes. This approach does not require consensus concerning a 
set of absolute standards, nor does it require the random assignment of eligible program applicants 
to experimental and control groups. Furthermore, because relative evaluations arc designed to 
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improve programs, rather than to justify them, there is greater incentive for program 
administrators to cooperate and to provide unbiased information regarding program outcomes. 

For the reasons outlined above, the guidelines suggested in this section pertain to relative, 
rather than absolute, evaluations. Our recommendations address three underlying issues: (1) the 
kinds of data that are likely to prove useful in conducting program evaluations; (2) how this 
information might best be collected; and (3) the most appropriate means of analyzing these data to 
provide useful information for program change and improvement. 
Data Requirements 

In some respects, relative evaluations require more effort and planning than absolute 
evaluations. When an evaluation is conducted for the purpose of program improvement, as much 
attention must be given to the various processes and practices that differentiate programs as to the 
measurement of outcomes. Furthermore, because program effectiveness is likely to vary 
according to the characteristics of clients served, it is equally important to collect data which 
provide a comprehensive description of program participants. Suggestions for the kinds of 
program, client, and outcome data that are likely to prove most useful to program administrators 
in evaluating local programs are presented below. 

Program Data 

• Context Data — site characteristics (e.g., residential or non-residential), program 
structures (e.g., voluntary or required), program-community integraUon, political 
support, diversity among learners, and broader economic forces. 

• Administrative/Organizational Data — individual program goals, funding sources, 
service provider, resources (e.g., per client expenditures), number of sites to which 
services are provided, availability of on-site support services, and leadership style. 

• Staffing Data — staff qualifications, client/teacher ratios, available support personnel, 
ratings of staff instractional ability, differentiation of mstructional roles according to 
staff category, and staff beliefs concerning education. 
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• Instructional Data — availability/utilization of instructional programs, instructional 
practices, placement/assessment procedures, curricula, flexibility of scheduling, and 
lelarive emphasis on academic versus functional literacy. 

CKent Data 

• Demographic Data — sex, race/ethnicity, age, and family status. 

• Employment Data — employment status at enrollment, number of months unemployed 
at enrollment (unemployed clients), description of last full-time position held, and 
employment goals. 

• Educational Data — number of years of education, standardized test scores, level of 
educational achievement (i.e.. Level I vs. Level A), ESL level (LEP clients), and 
educational goals. 

• Personal Problems — mental illness, history of dmg abuse, domestic violence, 
learning disabilities, and depression. 

• Support Services — services required and received, including case management, food, 
shelter, clothing, substance abuse counseling, mental health counseling, health care, job 
skills training, job counseling, job referral, child care, transportation, and legal 
counseling. 

• Educational Services — instructional programs, number of instructional hours (broken 
down by instructional strategy and approach), and identification of instructor(s). 

Outcome Data 

• Life Skills — life skills instructional areas and evaluation of accomplishments in those 
areas. 

• Basic Skills — basic skills instructional areas and accomplishments in those areas 
(e.g., standardized test score changes, movenient from Level I to Level n, etc.). 

• Affective Changes — changes in self-esteemi, self-confidence, internalization of 
control, and depression. 

• GED — GED and GED practice exam scores (broken down by the five GED test 
areas), number of hours of instruction between test administrations, and whether or not 
GED is obtained. 

• ESL — changes in ESL levels. 

• Adult Secondary Education — course credits received and whether or not adult high 
school diploma is obtained. 
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• Application of Skills — obtaining or improving emploj'ment, obtaining permanent 
housing, welfare status changes, changes in domestic relaiions, obtaining driver's 
license, U.S. citizenship, etc. 

Date Collection 

If evaluation data are to provide useful information for program improvement and change, 
they should be collected: (1) through uniform procedures that permit comparisons across program 
types and (2) at the level or levels — i.e., program, site, or client — which is/are most 
appropriate for their intended use. 

Uniform Proccdttres 

Data may be collected from a variety of sources, including local program administrators, 
principal instructors at each site, or client records/surveys. In each case, however, it is important 
that the information collected be uniform and, therefore, comparable across programs, sites, or 
clients of varying characteristics. Standardized reporting forms, such as those employed in this 
study, should be developed and utilized in collecting evaluation data. In addition, several further 
enhancements are recommended: 

• Project administrators should, as part of their regular monitoring visits, collect data on 
instructional programs and instructional quality; 

• In areas such life skills instruction, curricula should be developed which integrate 
instruction and assessment, thus providing a uniform means of assessing progress in 
these areas; 

• Local programs should be encouraged to record standardized achievement test scores 
when available (in particular, GED practice test scores should be recorded at each test 
administration); 

• Employing various standardized measures, clients' affective states (e.g., self-esteem, 
self-confidence, locus of control, depression, etc.) should be assessed at enroUment and 
at appropriate intervals thereafter; and 

• Statewide tracking systems should be implemented to provide more complete and 
accurate data pertaining to clients' success in applying newly acquired skills (only one 
in ten s' ••.s currently employ such systems). 





Levels of Data 



It is critical that data be collected at the level which is most appropriate for their intended 
use. For example, if the goal of an evaluation is to determine which instructional ^preach is 
most effective, data should be collected from the records of individual clients. In this way, 
clients' actual exposure to various j^proaches may be related to outcomes to determine the 
relative effectiveness of each approach. 
Analyzing Evaluation Data 

The data collected for relative evaluations may be analyzed, first, to provide an overall 
description of local programs and the availability/utilization of services and, second, to detennine 
which program characteristics and processes are most effective m producing positive outcomes for 
clients of varying characteristics. The former mode of analysis is more typical of current program 
evaluations, while tiie latter — although less typical — is potentially more valuable for the 
purpose of program improvement. Several guidelmes for conducting analyses of evaluation data 
follow: 

• Analytic comparisons should focus on program processes and practices, not programs 
per se. Each local program operates witiiin a unique context and serves a population 
witii unique characteristics. Given tiie limited number of local programs in each state, 
it is unlikely tiiat multivariate statistical techniques could be applied in such a way to * 
determme tiie overall relative effectiveness of one program versus anoUier. 
Furthermore, comparisons of this nature may undermme tiie program improvement 
goals of relative evaluations by inhibiting cooperation. 

• In evaluating tiie relative effectiveness of program processes and practices, data 
collected at tiie individual client level should be employed. Analyses based on data 
collected at higher levels of aggregation (i.e., site or program level) are generally 
inappropriate in identifying effective insttuctional practices and program sttuctiires 
because of tiieir reliance upon cross-level inferences. For example, using program 
data, one may conclude tiiat programs employing a high degree of individuahzed 
insttuction produce a greater number of successful GED candidates, but, unless one 
knows tiiat tiiese successful clients actoally received icdividualized instruction, it would 
be inappropriate to attribute tiieir success to that approach. 

• Finally, generalizations about tiie effectiveness of one practice or anotiier tiiat do not 
take into account individual client characteristics should be avoided. For example. 



Level I learners may respond best to one approach while Level n learners may respond 
better to another. 

Concluding Remarks 

Increasingly, local, state, and Federal funding agencies are demanding more quantifiable 
records of student growth as a measure of program effectiveness (Cranney, 1983). Yet the 
relative nature of literacy and the focus on learner-centered goals combine to make this a difficult 
adjustment for program administrators. 

The evaluation guidelines suggested here provide one means of closing the gap between 
what Fingeret (1984) has called the "public quantitative** and **private student-centered** goals of 
adult literacy education. By redefining the objective of program evaluations from one of survival 
to one of improvement, evaluations may begin to serve a more meaningful purpose and, 
ultimately, play an important role in the development of more effective programs. 
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APPENDIX A 

Descriptive Data: 
State-by-state 
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INTRODUCTION 



The summary tables which comprise this appendix arc based upon a review of U S 
Department of Education program ffles for each of the 35 AEH state projects funded for"l992 
and, m a few instances, data derived from the Local Program Survey (noted in table headings) 
Data are presented in four extended tables which cover the following topics: (1) characteristics of 
the target population served; (2) organization of services; (3) educational programs; and 
(4) evaluation. While these tables are self-contained and self-explanatory, several caveats are in 
order. First, most of the information included in this appendix is derived from U.S. Department 
of Education program files. Where Federal reporting guidelines require specific information (e g 
budget, support services, outreach, evaluation, etc.), the data are generally complete. However in' 
Uiose mstances where Federal guidelines do not reqmre tiie reporting of specific information (e g 
designation of single-sex sites and urban/rural location), data are provided at tiie discretion of state 
coordmators, and may, tiierefore, be incomplete. Second, altiiough aD data are reported at tiie 
state level, some descriptors vary only at tiie state program level (e.g., budgets) otiiers differ 
across local programs (e.g., service providers), while still otiiers vary site-by-site (e g service 
locations). These differences are specified in column headings to facilitate interpretation of tiie 
data. Thud, while data are generally comparable across states — unless otiierwise noted in tiie 
state-by-st^ footiiotes appended to tiie tables - state-level counts of tiie homeless population 
employ defmitions and counting mechanisms which vary so widely as to preclude cross-state 
companso^. Finally, budget and cost effectiveness data should be interpreted witii considerable 
caution While staie administiative costs range from less tiian two percent to nearly one-tiiird of 
toM budget, states vary substantially in tiie availability of existing mechanisms to administer tiie 
AEH program. As a result, simple cross-state comparisons of cost effectiveness which do not 
consider such differences are misleading. Cross-state comparisons of expenditures per client are 
equally imsleadmg unless evaluated in light of tiie level of services provided and tiie specific 
charactensucs of tiie population served. f *v 
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GENERAL NOTE 



An "X** indicates that the pro?^ :m has one or more programs or sites fitting the identified 
• category. For example, an "X*' on the "Organization: Part IT* chart under "Service Providers, 
LEA'* indicates that at least oue program in that state is operated by an LEA. Similarly, an "X** 
on the •Target Population" chart under "Family Status, Single Parent'* signifies that at least one 
site in that state targets single parents for educational services. Whether the unit of analysis is 
programs or sites is identified m the chart headings. 
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ALABAMA 

1 This program is intended to develop interagency coordination. Although local education 
boards will lead the effort, the service providers are primarily coordinators. 

2 Volunteers from service agencies will form a task force to publicize the project. In addition, 
successful students will be organized to recruit other students, 

3 Another outreach activity is direct mailing, 

4 Instruction is individualized, 

5 Curricula will be developed and tested within the course of the project, 

6 Non-traditional testing ^proaches, such as the Adult Performance Level, will be developed in 
the project. 



ARIZONA 

1 This is the estimated number of homeless people in the four areas targeted for services, 

2 Other targeted populations are teenagers, hispanics (especially migrant workers and refugees), 
and employable adults, 

3 The SEA requires subcontractors to provide a plan for coordinating services, ensuring 
accessibility, and conducting outreach activities. 



ARKANSAS 

1 This is the approximate number of homeless adults; total homeless number approximately 
16,096, 

2 Homeless veterans are a targeted group, 

3 Services have been provided in substance abuse and mental health facilities and local schools. 

4 One project is cosponsored by a literacy council and a board of education. 

5 Vocational technical schools will provide services. 

6 Role playing is used as an instmctional approach, Instraction is individualized or in small 
groups, 

7 Interpersonal skills trainmg is offered, 

2 if) 
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CALIFORNIA 



1 Veterans are another targeted population. 

2 Open houses are used for outreach. 



Scores on occupational tests such as the Career Orientation and Placement Survey. Career 
Ah±ty Placement, California Occupational Preference Survey, and EmployabiUty Competency 
System Appraisal Test arc used to identify participants* initial skills levels. ' ^ ^ 

The independent evaluator will use an instrument already pilot tested to identify successful 
and rephcable strategies. 



COLORADO 

1 Anotiier key support service is veterans benefits. 

2 The two instructional models are tiie traditional, in which teachers and/or tutors teach one-on- 
one or m smaU groups, and tiie intensive learning model, in which competency-based classes 
are condensed mto a one to tiiree week period of classes tiiree to six hours per day. 

^ ^dy ^ ^'^'^ '"^^ °^ P""'^^ ^''^^ employment, or continuing 

4 Six projects will undergo Program Evaluation and Educational Review (PEER) which 
includes self-review and an on-site team review. 



CONNECTiriTT 

' f^Z.Tr:^:i;^^. ^ ' "^^^^ " ^-cies 
2 Otiier providers include a homeless program network and a shelter corporation. 

lPP) is a comnete 

system of assessment, instiuction. and evaluation. 



3 The Connecticut Adult Performance Program (CAPP) is a competency-based, individualized 
system of assessment instruction anH Av»i„oti«« ' ' "'"'^^"uauzea 



DELAWARE 

1 This is tiie number of adults served by shelters in 1990. 

2 Targeted populations are tiie newly homeless and residents in transitional housing. 

A-21 



Adult education agencies affiliated with the local school districts will provide services. 
Referral to Even Start programs is provided. 

The instructional approach will include workshops and individudized and group instruction. 
The core curriculum is the Adult Basic Skills Curriculum developed by Learning Unlimited. 



1 This is the number of homeless on any given day. 

2 Classes are also offered at elementary schools and half-way houses. 

3 Billboards have been used for outreach. 

4 The projects refer students for crisis intervention. 

5 Public health care facilities have given preference to homeless students and public utilities 
have reduced expenses for student families moving into apartments. 

6 Each project is developing its own curriculum. 



1 The Hawaii Department of Education is responsible for the sites, although each site will have 
a coordinator and outreach specialists. 

2 Instruction is one-on-one or in small or large groups, depending on the student's needs. 

3 The Test of Applied Literacy Skills is also used. 



1 Formerly homeless families who have been housed but are still at risk of homelessness are 
one target population. 

2 Out-of-school youth, ages 16 to 21, are another target population. 

3 Services may also be provided in a home visitation program for formerly homeless families. 



FLORIDA 



HAWAn 



A.22 




4 A private, non-profit homeless service agency is the prime contractor; this agency manages 
the contracts with CBO homeless service and basic skills providers. Instruction is provided 
by adult basic education programs, CBO's, volunteer literacy programs, etc. 

5 Individual tutoring and classroom instruction will be used to deliver educational services. 

6 New assessment instruments are being developed for the project. 



INDIANA 

1 Another target population is the educationally disadvantaged. 

2 For off-site programs, clients are referred to agencies that can provide mmsportation. 

3 One service provider is a network for -employment and training. 

4 Additional instructional approaches include: tutoring, cooperative learning, peer tutoring, and 
paired learning. 

5 G^hor assessment instruments include: the Woodcock, Slosson Oral Reading Test, Raven, 
Test That It, Not a Test, and English as a Second Language Oral Assessment. 

KANSAS 

1 A mobile van also provides literacy services. 

2 Religious organizations also provide literacy services. 

3 The instructional approaches include one-on-one tutoring, group training, and experiential 
learning. 

4 An individualized placement instrument, developed by the Wichita Public Schools, is used 
form placement. 

MAtNE 

1 Another target population is the chronically homeless. 

2 Instruction is also provided at locations convenient to the student, such as libraries and homes. 

3 Teachers become more involved with the students by spending an orientation day as a 
homeless client, by volunteering for food distribution, or by attending shelter meetings. 

~0 A-23 p J o 

ERIC "^^^ 



4 Students are also referred to support services such as budgeting assistance. 

5 Instruction is delivered individually and in focus groups. 

6 Other placement instruments include: Reading Evaluation Adult Diagnosis (READ), Informal 
Reading Inventory, O'Donnell Informal Assessment, GED pre-test. Literacy Assessment 
Survey, Adult Placement Indicator, Self-Directed Search, and Career Decision Making System. 

7 Other assessment instruments inciade READ and the GED. 



MARYLAND 

1 This represents the number of homeless adults. 

2 Instruction is primarily individualized, with some group instruction. 

3 The Maryland Adult Performance Program (MAPP) life Skills curriculum is used. MAPP is 
a competency-based curriculum. 

4 Clients are placed and assessed using the M>PP assessment instrument, which incorporates 
CASAS. 



MASSACHUSETTS 

1 Other target populations include out-of-school youth, first-time homeless adults, chronically 
homeless adults, seasonably homeless, and refugees. 

2 Adult education for the homeless is provided through networks led by either a homeless 
shelter or an experienced adult learning center. Each network consists of eight to twelve 
partners including at least one adult learning center, one homeless shelter, and other homeless 
service providers. 

3 Other support services provided by the network include crisis intervention and housing 
advocacy. 

4 Different education plans are used for different types of students. For example, single parents 
use the time line model, individual adults use the daily goal assessment model, out-of-school 
youth separated from their children use contractual goal setting, first-time homeless families or 
parents set goals on three levels (immediate, family and self), and chronically homeless or 
mentally ill adults use "Let*s Plan for Tonite!** 

5 The program progresses from mdividualized to community-oriented: first the lEP, then one- 
to-one instruction, tutoring, groups, classroom, study buddy, peer teaching, and connections to 
public institutions such as libraries. 

erJc ^'^"^ ^^"^ 



6 Each type of student is assessed with a distinct approach. Smgle parents use the life points 
assessment models individual adults use a journal scrapbook, out-of-school youth separated 
from their children use portfolios and verbal practice GED tests, first-time homeless families 
or parents use standardized tests (Brigance Inventory, Stanford Diagnostic Reading, GED 
pretests, Ullman/ESL, or Slosson Oral Reading Test), and chronically homeless or mentally ill 
adults use word, symbol^ number, self, and environment recognition. 



MICfflGAN 

1 Data derived from state program files. 

2 Developmentally disabled adults are a targeted population. 

3 Homeless Adult literacy Programs (HALF) were established in targeted communities and 
staffed with a HALF coordinator and, at some sites, literacy volunteers and paid instructors. 
HALF is an interim program, providing educational services when appropriate, and referring 
clients to other educational services when appropriate. In the latter case, HALF provides 
educational support. 

4 Other standardized tests include Reading Evaluation Adult Diagnosis (READ), and Adult 
Placement Indicator (AFI). 



MINNESOTA 

1 Homeless adults between the ages of 16 and 24 and extended family adults are targeted 
groups. 

2 One projea does not provide education services directly; formerly homeless mentors help 
homeless young adults connect to existing educational opportunities and other resource 
agencies. 

3 Trained peer mentors locate homeless young adults and guide them towards services. 

4 Lnstructional approaches include workshops, seminars, classes, and parent-child play groups. 

5 The family self-help curriculum focuses on and was developed by homeless families of color. 

6 Participants will track progress towards goals and attendance. One project is using individual 
journals for assessment. 
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MISSOURI 

1 Other sites for education services are a mental health center, community based organization, 
high school, and medical center. 

2 Instruction is provided individually and in groups. 

3 The Slosson Oral Reading Test is used for assessment. 

MONTANA 

1 The grade level of materials last used serves as the posttest. 

NEBRASKA 

1 Services are targeted for handicapped adults. 

2 Educational services are also provided in a church. 

3 A recruitment display is set up at Social Services offices on the day checks are distributed. 

4 Eyeglasses and services for the handicj^ped are provided. 

5 Instruction is predonmiatsiy individualized, with group instruction for topics relevant to the 
entire class. 

6 Assessment instruments included the Test That's Not a Test (T-NAT) — an informal oral 
reading inventory, the Nebraska Interview ~ a short, oral mterview for ESL students, and 
LABELS interest inventory. 

NEVADA 

1 This number does not include American Indians livmg on reservations and in urban American 
Indian housing colonies. 

2 Services are provided in Indian colonies. 

3 Housing assistance is another support service. 

4 Basic literacy skills are taught through a curriculum centered on life skills. 
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NEW HAMPSfflRE 

1 Shelters served 8,684 homeless people last year and turned away people over 3,300 times. 

2 Data derived from state program files. 

3 ABE and ESL instruction is targeted for people caring for race horses. 

4 A halfway house and a race track are service delivery locations. 

5 Volunteer tutors affiliated with the LEAs and adult education centers provide educational 
services. 

6 Tutors meet with all new shelter residents. 

7 Another outreach activity is sending program information to agencies providing services to the 
homeless. 

8 Instruction occurs individually and in classes. 

9 FUTURES is a Vermont curriculum focusing on self-esteem and self-directed learning. 

10 Readiness to learn is determined by the individual's expressed interest, the Slosson Oral 
Reading Test, Reading Evaluation Adult £>iagnosis (READ), Brigance, Gates, or BEST, a 
written essay, an interest inventory, and a personal interview. 

1 1 Progress tests include READ, the Wide Range Achievement Test (WRAT), Brigance, BEST, 
and GED practice and final test scores. 

NEW YORK 

1 Adult education is provided at BOCES, LEAs, and CBOs. 

2 LEAs and BOCES and a school board provide educational services. 

3 Adults learn independently except in ESL classes. 

4 Curricula include the Adkins Life Skills Program and the New York State Life Management 
Program. 

5 Another placement measure is John; the program is field testing the NYS Place Test. 
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NORTH CAROLINA 

1 Developmentally disabled adults and adults waiting for subsidized housing are targeted 
populations. 

2 Although education services are provided on-site, transportation is provided if a student must 
go to another site for specialized training. 

3 PLATO software is used. 

4 **Life Skills for the Homeless/* a curriculum developed in North Carolina, teaches basic skills 
in the context of life skills such as job hunting or budgeting. 

5 *The Twelve Step Curriculum,** also developed in North Carolina, is geared towards substance 
abusers. Other curricula used include the PLATO Basic Skills Curriculum and Basic Literacy 
for Adult Development (BLADE)- 

6 SORT is also used for placement. 

7 Clients are assessed with entrance and exit interviews. 



NORTH DAKOTA 

1 This is the number of homeless people served by agencies in 1990. 

2 Assessment instruments available to be used at local sites include: the California 
Achievement Test, the National Career Aptitude Test and the National Career Aptitude Test 
READ, the Wide Range Achievement Test (WRAT), Interest Inventory, the Test of Adult 
Basic Education, Cambridge Interpreting Literature and the Arts Test, and GED sample tests. 



OHIO 

1 Adults waiting for subsidized housing are targeted for educational services. 

2 Long-term facilities for substance abusers are service delivery locations. 

3 Each local project will employ a person responsible for outreach and recruitment. 

4 Suggested approaches include: leamer-centered instruction, small group instruction, peer 
tutoring and cooperative learning, and use of printed materials students are likely to need. 

5 Local programs choose or develop their own assessment instruments; alternative assessment 
instraments are encouraged. 
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■ OKLAHOM A 

■ 1 This represents the number of clients receiving services from domestic violence shelters. 
^ 2 Data derived from state program files. 

3 The Adult Learning Center of the LEA in which each shelter is located will provide certified 
^ adult basic education instructors. 

4 GED test fees are paid through the grant. Referrals to housing agencies are also provided. 

■ 5 Participants may remain in the shelter until the end of the course. 

H 6 Participants functioning at or above the eighth grade reading level use GED practice test 

fl scores for placement. 

g 7 Thi J test is administered as a pre- and posttest. 

I RHODE ISLAND 

jm 1 This total represents the number of persons admitted to shelters within a one-year period. 

2 Street youth, unemployed (dislocated or disabled workers), or hidden homeless are targeted for 
mt services. 

3 Instruction is provided with tutorials and classes, using methods such as the whole language 
mm approach, learner contracts, and process writing. 

4 Clients placement is based on recommendations by shelter staff or case managers. 
P 5 The LVA Read Test is also used for placement. 

. 6 Learner gains are measured with portfoHos, the LVA Read Test, and Scott Foiesman Infomial 

■ Reading Inventory. 

TENNESSEE 

I 1 This is an estimate of the number of homeless on any given day. 

■ 2 Data derived from state program files (one-half of projected number). 
3 Displaced homemakers and former prisoners arc targeted groups. 

p 4 Services are provided in a halfway house. 
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5 Religious organizations also provide services. 

6 Active education enrollment is a prerequisite for receiving support in the second phase of the 
homeless person's program. 

7 The Laubauch Way to Read, Steck-Vaughn Reading for Today, or other materials are used in 
this program. 

8 Adults are also assessed with the SelectAble locator test or Blossom. 

TEXAS 

1 Services are provided by the Adult Education Cooperative; however, the location of classes is 
not specified. 

UTAH 

1 Adults waitmg for subsidized housing are targeted for educational services. 

2 At one site, the homeless must be referred to the Adult Education and Job Services office 
before receiving a second night of lodging. 

3 In the Emergency Work program, cUents must attend classes to p?ceive funds. 

4 The Student Education Occupational Plan (SEOP) is used as an lEP. 

5 Instruction is provided through peer tutoring, small group interactions, and classroom 
instruction. 

VERMONT 

1 Adults at risk of homelessness, parolees, and homeless without a roof are targeted populations. 

2 Emergency fuel is provided. 

3 Homeless service providers are trained in outreach and literacy services. 
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WASfflNGTON 

1 This is the number of adult homeless between July 1990 and April 1991, including 40,949 
actually sheltered and 72,150 turned away. 

2 Other targeted populations include: Hispanic, African-Americans, recently released prisoners, 
and cyclically homeless men. 

3 Services are also delivered at a halfway house for released prisoners; a mobile learning van; 
substance abuse, mental health, and job service centers; Indian tribal centers; and powwows, 
fiestas, and other cultural activities. 

4 Tribal organizations also provide services. 

5 Assistance to learners who are developmentally disabled, parenting training, infant supplies, 
support groups, furniture, utilities and weatherizing are offered. 

6 The lEP includes long and short range student goal statements; assessment of core 
competencies based on poitfolios, interviews, observation, and standardized tests; and a 
learning contract. 

7 Elements of curriculum development include: teaching affective skills, modular instruction, 
interactive and individualized instruction, homeless-specific materials and methods, a variety 
of informal and formal assessments, prior approval for formal assessment instniments, BEPs, 
portfolio evaluation, sensitive and compatible staff. Homeless Educational Network for 
Records of Instruction (HENRI), CASAS, Washington State Core Competencies Curricula, 
life Quest, Within Our Reach, and lifeskiUs for the Homeless. 

8 Other standardized assessment instruments include: the Basic English Test (BEST) and the 
Peabody Individual Achievement Test (PIAT). Standardized instruments are used to evaluate 
adults in the program after a minimum of 75 hours of instruction. The lEP and Student 
Achievement Record (StAR) are used to ass^ progress of short-term students. 



WEST VIRGINIA 

1 Funding is channeled through the local school board to the projects. The State Department of 
Education hired a project coordinator to manage the program. The West Virginia Coalition 
Against Domestic Violence supervises the shelters directly. 

2 Instructors locate former shelter residents and encourage them to return to the program for 
counseling and classes. 

3 The program also refers students to agencies for testing. 

4 Instruction is generally in small groups or individualized. 
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WISCONSIN 



1 Two-year vocational technical and adult education colleges receive grants to operate the adult 
education for the homeless program at shelters, 

2 The program will be publicized at. a statewide conference, 

3 Emphasis in this program is on transitioning students to long-term, on-campus adult education 
programs, 

4 Housing counseling is also provided on-site in some shelters. 

5 Each program is set up in a learning center design. Education begms with an individuaUzed 
approach and progresses to small groups, 

6 An intake interview and worksheets are part of the client placement process. 

7 GED pretests are also used to place clients. 
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State and Local Surveys 
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(DO NOT WRITE IN TOIS SPACE) 




STATE PROJECT: 



(Affix State Project 
Identification Label here.) 



INSTRVCTIQNS ; This State Projea Survey should be completed by the Adult 
Education for the Homeless (AEH) State Project Director. Uave questions blank 
respond "Don't know. " if the information is unavailable or if you are not certain . 
the correct response. 



I. STATE PROJECT OVERVIEW 



What are the principal objectives of the AEH project in this state? (Circle aU that apply.) 

GED/Adult Secondary Education completion 
Basic skills improvement (literacy/ABE instruction) 
English as a Second Language (ESL) 
Life skills improvement 
Independent living/housing acquisition 
Pre-employment training 
Self-esteem development 

Other (Specify: 



-) 



Were educational services for the homeless available through a state project that specifically 
targeted that population prior to tius suite's participation in the AEH program? 



0 
1 



No 
Yes 
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How long — expressed in MONTHS — has this state's homeless education project existed to 
date? (Please express your answer in months, even if your state's project has existed for 
more than a year. If this project existed prior to receiving AEH funds, include those 
months as well) 



months 



How many MONTHS has this project received AEH funding? (Include this and previous 
years of funding, including entitlement grants.) 



months 



What type of coordination of services for the homeless — both educational and non- 
educational — exists at ttie state level? (Circle aU that apply.) 



1 Statewide advisory group 

1 Shared funding 

1 Inter-agency referral agreements 

1 Inter-agency needs assessments 

1 State 'Tiot line" 

1 Other (Specify: ^ 

With which Federal programs does this AEH state project coordinate? (CircU aU that apply.) 

1 Adult Education Ad (AEA) 

1 Job Training and Partncrshfe Act (JTPA) 

1 Job Opportunities and Basic Skills — Welfare Reform Act (JOBS) 

1 Even Start (Family Literacy) 

1 Homeless Children and Youth 

1 Head Start 

1 Otiier (Specify: 

What are tiie THREE most important challenges to tiie implementation or development of ttiis 
AEH state project tiiat you have faced during THIS project year? (CircU the THREE 
answers that best apply.) 

1 Lack of support ftom State Educational Agency 

1 Lack of support from other state agencies 

1 Uncertainty of funding from year to year 

1 Delays in the awarding of funding 

1 Inadequate funding 

1 Low priority of educational services among agencies working witti tiie 
homeless 

1 Lack of local program applicants 

1 Otiier (Specify: 

7 No major challenges during cunent project year 
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Choose the most critical challenge to project implementation or development that you have 
successfully overcome and briefly describe how this was accomplished. 



11. STATE PROJECT ADMINISTRATION 



How many professional and support staff members at the state level currently conunit time to 
the administration of this AEH project? 

professional(s) 

support staff 

On average, how many hours per week of professional and support staff time are spent 
administering this project? 

hours/week professional(s) 

hours/week suiqwrt staff 

Was the position of State Project Director newly funded through the AEH grant or was this 
role taken on by an existing staff person? 

1 Newly funded position (GO TO QUESTION 11] 

2 Existing staff 

What other position does this existing staff person hold? 

1 State Director of Adult Education 

2 Section 353 Coordinator 

3 Other (Specify: ) 

How many years of adult education experience does the State Project Director have? 

years 
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12. How many years of experience with the homeless does the State Project Director have? 

years 

13. How many years of experience managing educational programs does the State Project Director 
have? 

years 

14. To whom does the State Project Director report? (Title only.) 



15. Which of the following functions is (are) performed by the State Project Director and support 
staff? (Circle all that apply.) 

1 Seeks additional sources of funding at state level 

1 Seeks additional sources of funding at local level 

1 Provides technical assistance to local programs 

1 Monitors local programs 

1 Evaluates local programs 

1 Promotes staff development activities 

1 Promotes curriculum development/dissemination 

1 Other (Specify: ) 

16. Which of the following BEST describes the current administrative relationship between the 
State project and local programs? (Circle the ONE answer that best applies.) 

1 Educational service provider(s) receive grant from the state to deliver or 
coordinate the delivery of educational services at one or more sites 

2 Non-education agency(ies) receive grant from the state to deliver or coordinate 
the delivery of educational services at one or more sites 

3 Both 1 and 2 above 

4 State directly manages local programs 

5 Other (Specify: ) 



17. What type of technical assistance could the U.S. Department of Education provide to assist 
you in administering this project? (Circle all that apply.) 



1 Clearer proposal guidelines 

1 Standardized reporting forms 

1 Training aimed specifically at working with the homeless 

1 Information about homelessness 

1 Information about other AEH state projects 

1 Curriculum models/training 

1 Assessment models/training 

1 Evaluation guidelines 

1 Other (Specify: ^) 

7 No technical assistance needed 
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(DO NOT WRITE IN THIS SPACE) 



SITE NAME: 

RESPONDENTS (see Instructions below): 

Local Program Coordmaior 



Principal Instructor or Other Key Stcff Person 

LOCAL PROGRAM: 

STATE: 

EXPECTED NUMBER OF PARTI dPANTS (Current Program Year): 

Enter the expected number of participants at this site only. 



INSTRUCTIONS : Please complete one "Site Data*' form for each site served by this 
local AEH program Sections I and II (questions 1-28) are to be completed by the 
local program coordinator, while Sections III and IV (questions 29-57) are to be 
completed by a principal instructor or other key staff person at the site named above 
Leave questions blank or respond "Don't know, " if the information is unavailable or 
if you are not certain of the correct response. 



L LOCATION AND ACCESSIBILITY OF EDUCATIONAL SERVICES 



Is this a residential site? (For the purposes of this and other questions, ''residential sites'' 
include shorts and long-term shelters, transitional housing, and other facilities providing 
temporary shelter to homeless individuals and families.) 

0 No [GO TO QUESTION 11] 

1 Yes 

2. Approximately what proportion of the residents at this site currently participate in the AEH 
program? 

% 

3. Approximately what proportion of AEH program participants served at this location currently 
reside on-site? 

% 
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What kind of residential site is this? (Circle the ONE answer that best applies. Please do 
not describe the residential site in Urms of the characteristics of clients served. For 
example, an emergency shelter for victims of spousal abuse and a shelter for migrant 
workers are both regarded as "sheUers. " Similarly, transitional housing for the mentally iU 
and transitional housing for recovering drug/aleohojl abusers are both regarded as 
"transitional housing. 

1 Shelter 

2 Transitional housing 

9 Oflier (Specify: — _ ) 

What is the maximum number of consecutive nights that residents are normally permitted to 
stay at tiiis site? (Please express your answer in number of nights^e., 1 week = 7 nights, 
1 month = 30 nights, 1 year = 365 nights, etc. Enter ''777'' if there is no specificaUy 
designated maximum stay at this site.) 

nights 

Are longer than normal stays permitted for residents participating in tiie AEH program? 

0 No [GO TO QUESTION 8] 

1 Yes 

7 Not applicable [GO TO QUESTION 8] 

8 Don't know [GO TO QUESTION 8] 

How many additional nights may clients participating in the AEH program reside at this site? 
(Circle the ONE answer that best applies.) 

1 Up to 30 additional nights 

2 From 31 to 90 additional nights 

3 More than 90 additional nights 

4 Until program completion 

7 Not applicable 

8 Don't know 

May clients continue to participate in the AEH program after discontinuing residence at this 
site? 

0 No [GO TO QUESTION 10] 

1 Yes 

Approximately what proportion of clients continue to participate in the AEH program after 
discontinuing residence at this site? 

% 

Is participation in the AEH program REQUIRED as a condition of residence at this site? 

0 No [GO TO QUESTION 12] 

1 Yes [GO TO QUESTION 12] 
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1 1. How would you describe this NON-RESIDENTIAL site? (Circle the ONE answer that best 
appUes.) 



1 Adult learning eer ier 

2 Community center or Y 

3 Salvation Army 

4 Homeless day center 

5 Soup kitchen 

6 Library 

7 School or community college classroom 

8 Church 

9 Other (Specify: ) 

12. What is the single most common means of transportation that clients use to get to this site? If 
this is a residential site, what is the single most common means of transportation used by 
NON-RESIDENTIAL clients? (CircU the ONE answer that best applies.) 

1 Walk 

2 Client's personal vehicle 

3 Van or other transportation provided by program 

4 Mass transpoitation 

5 Not ^licable/all clients are residents at this site [GO TO QUESTION 14] 
Other f.^nerffv- A ^ 



6 Other (Specify: 
8 Don't know 



13. Are transportation vouchers provided to program participants at this site? 



0 No 

1 Yes 

14. Is child care provided for the children of program participants at this site? 

0 No 

1 Yes 

15. Please rate the adequacy of the physical setting where educational services are provided at this 
site. 

1 Excellent 

2 Good 

3 Fair 

4 Poor 

16. What problems exist with the physical setting where educational services are provided at this 
site? (Circle all that apply.) 

1 Noise 

1 Lack of privacy \ 
1 Inadequate space 

(Continued next page) 
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1 
1 
1 
1 
1 

7 



Inadequate furnishings 
Safety hazards 

Lack of security for clients and teachers 
Lack of secured room for storage 

Other (Specify: 

No problems 



II, INSTRUCTIONAL STAFF 



NOTE: In this section, ''Instructional Staff* is defined as all paid and volunteer 
teachers, tutors, and other staff members who directly provide instruction. 

17. How many instructional staff members are there at this site? 



18 What i3 the TOTAL number of hours of instruction offered each week by instructional staff 
members at this site? (EXAMPLE: If three instructors each offer 20 hours of instruction 
per week, report 60 total hoursfweetu) 
♦ hours/week 

19. What is the AVERAGE number of years of post-secondary education for instructional staff 
members at this site? 

years 

20. How many instructional staff members at this site have graduated from college? 



21. What is ttie AVERAGE number of years of adult education teaching experience for 
instructional staff members at this site? 

years 

22. What is ttie AVERAGE number of years of expentnce with ttie homeless for instructional 
staff members at this site? 

years 

23. How many instructional staff members at tiiis site are certified i: elementary or secondary 
education? 



24. How many instructional staff members at Uiis site are certified in adult education? (// none 

are certified because certification in adult education is not offered in your state, enter ''77.'*) 
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25. How many instructional staff members at this site are female? How many are male? 

females 

males 

26. How many instructional staff meml)ers at this site are volunteers? 



27. Do volunteers at this site perform essentially the same function(s) as their paid counterpaits? 

0 No 

1 Yes 

28. How many individuals provide counseling services at this site? 



m. EDUCATIONAL SERVICES 



29. Please indicate the principal EDUCATIONAL SERVICE PROVIDER at this site. (Circle the 
ONE answer that best appUes.) 

1 Public school local education agency 

2 Conmiunity college . 

3 Shelter/transitional housing 

4 Community organization 

5 Volunteer literacy organization 

6 Church-affiliated organization 

7 Other (Specify: \ ; 



30. How is instruction offered at this site? (Circle all that apply.) 

Individualized instruction (oneK>nK)ne with a teacher or tutor) 
Large group (classroom) instruction 
Small group instruction 
Peer tutoring 
Self-instiuction 
Computer-assisted instruction 

Other (Specify: 



31. Which instructional 'approach has proven most effective for the greatest number of clients 
served at this site? (Circle the ONE answer that best applies.) 

1 In<lividualized instruction 

2 Lat;^.e group (classroom) instruction 

(Continued next page) 
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3 Small group instruction 

4 Peer tutoring 

5 Self-instruction 

6 Computer-assisted instruction 

7 Other (Specify: 



97 No single most effective approach 
To what do you attribute the effectiveness of this approach? 



32. What strategies for instruction are employed at this site? (Circle all that apply.) 

1 Cooperative learning 

1 Intergenerational learning (parent and child learning together) 

1 Experiential learning 

1 Workbook based instruction 

1 Creative writing 

1 Other (Specify: — ) 

33. Which strategy for instruction has proven most effective for the greatest number of clients 
served at this site? (Circle the ONE answer that best applies.) 

1 Cooperative learning 

2 Intergenerational learning 

3 Experiential learning 

4 Workbook based instruction 

5 Creative writing 

6 Other (Specify: ) 

7 None of the above 

To what do you attribute the effectiveness of this strategy? 
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What type of instnictional materials are used at this site? 



1 Commercial 

2 Customized 

3 Combination of both 

4 Other (Specify: 

Are modular (i.e.. short-term, self-contained) instructional materials used at this site? 

0 No [GO TO QUESTION 37] 

1 Yes 

How effective are modular instructional materials for the clients served at this site? 

1 Extremely effective 

2 Somewhat effective 

3 Not very effective 
8 Don't know 

Does this site pubUsh a student-produced newsletter or other pubUcation as part of its 
educational program? 

0 No 

1 Yes 

Is information regarding each student recorded in individual educational plans at this site? 

0 No [GO TO QUESTION 40] 

1 Yes 



What is included in these individual educational plans? (Circle all that apply.) 

1 Narrative 

1 Student goals 

1 Sex 

1 Race/ethnicity 

1 Marital and family status 

I Employment status 

1 Welfare status 

1 Disabilities (e.g., mental illness, learning disability, physical handicap, etc ) 

1 Hi&tory of drug/alcohol abuse 

1 Domestic abuse 

1 Last year of school completed 

1 Enrollment literacy level 

1 Level of English iwoficiency 

1 Standardized placement test scores 

1 Standardized achievement test scores 

1 Competency achievement 

1 Referrals 

1 Other (Specify: 
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What educational programs are offered at this site? (Circle aU that apply.) 



1 General Educational Development (GED) 

1 Adult Secondary Education 

1 Adult Basic Education (ABE) 

1 English as a Second Language (ESL) 

1 Employability skills 

1 Life skills 

1 Self-esteem . 

1 Other (Specify: — ~' 

How are students assessed for program placement at this site? 

1 Standardized assessment 

2 Informal placement [GO TO QUESTION 43] 

Which standardized assessment instruments are used for PROGRAM PLACEMENT at this 
site? (Circle all that apply.) 

1 TALS 

2 CASAS 

3 TABE 

4 ABLE 

5 WRAT 

6 GED practice test 

7 Other (Specify: 

What are the THREE most useful means of measuring the success of the AEH program at this 
site? (Circle the THREE answers that best apply.) 

1 Standardized achievement test gains 

1 Number of clients completing or making progress toward an adult secondary 

education diploma (Adult lligh School diploma) 
1 Number of clients passing or making progress toward the GED 
1 Number of clients completing ESL instructional level(s) 
1 Number of cUents completing or making progress in Level I (limited basic 

skills competent or functioning at grades 0-8 equivalent) 
1 Average number of contact hours 
1 Competency-based achievement gains 

1 Social/psychological gains (e.g., enhanced self-esteem, improved social skills, 
etc.) 

1 Number of clients obtaining housing 

1 Number of clients getting off welfare 

1 Number of clients obtaining or improving employment 

1 Nmcber of clients placed in other training or educational programs 

1 Number of clients achieving personai goals (short- and long-term) 

1 Other (Specify: 

7 None of the above 

8 Don't know 

8 



44. If standardized assessment instmments are used as a means of MEASURING SUCCESS at 
this site, indicate which standardized assessment instruments are used. (Circle ail that apply,) 

1 TALS 

1 CASAS 

1 TABE 

1 ABLE 

1 WRAT 

1 GED practice test 

1 Student portfolio assessment 

1 Other (Specify: 

7 Not ^licable/standardized assessments not used 

45. Are any incentives used to reward participation in the AEH program at this site? 

0 No [GO TO QUESTION 47] 

1 Yes 

46. Please indicate those incentives used to reward participation at this site. (Circle aU that 
apply.) 

1 Longer shelter stays (residential sites only) 

1 First in line at lunch or dinner 

1 Gifts of clothing, personal effect, etc. 

1 Certificates of achievement 

1 Special trips or outings 

1 Other (Specify: ^ 



IV. PROGRAM PARTICIPANTS 



To which of the following sub-populations does the GREATEST proportion of clients 
currenfly served at this site belong? (CircU the ONE answer that best applies.) 



1 


Victims of spousal abuse 


2 


Recovering drug/alcohol abusers 


3 


Mentally ill 


4 


Migrant workers 


5 


Veterans 


6 


Native Americans 


7 


Limited English proficient 


8 


Learning disabled 


9 
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No particular sub-population served [GO TO QUESTION 49] 
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48. Approximately what proportion of the clients currently served at this site are from this 
particular sub-population? 

% 

49. To which of the following ciemogn4)hic groups does the GREATEST proportion of clients 
currently served at this site belong? (Circle the ONE answer that best applies.) 

1 Men living alone 

2 Women living alone 

3 Sihgle-parent men (with dependent children) 

4 Single-parent women (with dq)endent children) 

5 Men living with an adult partner (without dependent children) 

6 Women living with an adult partner (without dependent children) 

7 Men living with an adult partner (with dependent children) 

8 Women living with an adult partner (with dependent children) 

50. Approximately what proportion of clients currently served at this site belong to this 
demograpiiic group? 

% 

51. To which of the following age groups does the GREATEST proportion of clients currently 
served at this site belong? (Circle the ONE answer that best applies.) 

1 16-24 years 

2 25-44 years 

3 45-59 years 

4 60+ years 



52. Approximately what proportion of clients currently served at this site belong to this age group? 

% 

53. Are the majority of clients served at this site at Level I (limited basic skills competent or 
functioning at grades 0-8 equivalent) or Level n (competent, but not proficient, or functioning 
at grades 9-12 equivalent)? 

1 Level I 

2 Level II 

3 About equally divided between the two levels 
8 Don't know 

54. How much variation is there in the educational levels of clients served at this site? 

1 A great deal 

2 Some 

3 Very little (all at about the same level) 
8 Don't know 
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Approximately how many TOTAL hours of instruction does the average client at this site 
receive? 

total hours 



What proportion of AEH students at this site participate in the program for more than two 
weeks? 

% 

More than one month? 

% 

More than three months? 
% 

What is the PRINCIPAL reason for client separation from the AEH program at this site? 
(Circie the ONE answer that best applies.) 

1 Met educational objectives 

2 Program did not meet client's educational needs 

3 Took a job 

4 Entered another educational/training program 

5 Forced to leave shelter/transitional housing because of stay limitation 

6 Forced to leave shelter/transitional housing for other reasons 

7 Left shelter/transitional housing voluntarily 

8 Moved out of the area 

9 Experienced difficulty obtaining child care 

10 Experienced difficulty obtaining transportation to instructional site 

11 Incarcerated 

12 Institutionalized due to mental illness or drug/alcohol abuse 

13 Clients' fear of failure regarding education 

14 Other (Specify: ) 

98 Don't know 



THANK YOU FOR YOUR PARTICIPATIONl 
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LOCAL PROGR4M SmVEY^ CLIENT DATA 



CLIENT'S nRST NAME OR INITIALS: 

STAFF MEMBER COMPLETING THIS SURVEY:^ 

SITE NAME: 

LOCAL PROGRAM- 

STATE: 

DATE OF ENROLLMENT 

(!•€., First Itey of Program Participation): 6 / / 92 

(Mo.) (Day) (Year) 

END OF THREE-MONTH REPORTING PERIOD 

(i.e^ Three Months After Date of Enrolbnent): 9 / / 92 

(Ma) (Day) (Year) 

INSTRUCTIONS : Please ask instructional staff members at the site named above to 
complete one "Client Data" form for each client who enrolled for the first time at this 
site during the month of June, 1992. Unless otherwise directed, please report client 
data for the THREE-MONTH period following enrollment (defined here as the first 
day of program participation). Leave questions blank, or respond "Don't know, " if 
the information is unavailable or if you are not certain of the correct response 



1. BACKGROUND INFORMATION 



1. Sex: 

1 Male 

2 Female 

2. Race/ethnidty: 

1 White (not of Hispanic origin) 

2 Black (not of Hispanic origin) 

3 Hispanic 

4 Asian or Pacific Islander 

5 American Indian or Alaskan Native 
8 Don't know 
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3. 



Age at enrollment: 



years 



4. Family status at enrollment: 



1 Living alone (single, widowed, or divorced) 

2 Single parent (with dependent children) 

3 Living with adult paitner (without dependent children) 

4 Living with adult partner (with dependent chUdren) 
8 No record exists 

5. Employment status at enrollment: 

1 Employed full-time [GO TO QUESTION 7] 

2 Employed part-time [GO TO QUESTION 7] 

3 Unemployed 

8 No record exists [GO TO QUESTION 7] 

6. Number of months unemployed at enrollment: 

months 

7. Number of months homeless at enrollment: 

months 

8. Educational level at enrollment: 

1 Level I (limited basic skills competent or functioning at grades 0-8 

equivalent) 

2 Level II (competent, but not proficient, or functioning, at grades 9-12 

equivalent) 
8 No record exists 



9. Number of years of education at enrollment (circle highest grade completed): 

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17+ 

10. Did this client enroll in the AEH Ingram at a RESIDENTIAL site? (For the purposes of this 
and other questions, '^residential sites** include short' and long-term shelters, transitional 
housing, and other facilities providing temporary shelter to homeless individuals and 
families.) 

0 No [GO TO QUESTION 12] 

1 Yes 

8 No record exists [GO TO QUESTION 12] 
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Did he/she reside on site during all or part of the three-month p^od following enrollment? 

0 No 

1 Yes 

8 No record exists 



n. SUPPORT SERVICES 



During tlie three-month period following enrollment, ^ch» if any» of the following support 
services did this client RECEIVE — either directly or by referral — as a result of his/her 
participation in tiie AEH program? (Circle all that apply.) 

1 Shelter 

1 Food 

1 Clothing 

1 Substance abuse counseling 

1 Mental health counseling 

1 Healthcare 

1 Childcare 

1 Transportation 

1 Job skills training 

1 Job counseling 

1 Job referrals 

1 Legal counseling 

1 Other (Spediy: ; ) 

7 No support services received 

8 No record exists 

Did this client receive case management services (i.e., comimhensive assessment and referral) 
at any time during the three-month period following enrollment? 

0 No 

1 Yes 

8 No record exists 



m. EDUCATIONAL SERVICES/OUTCOMES 



How many TOTAL hours of instruction did this client receive during the three-month period 
following enrollment? 

hours 



2'iJ. 



15. Approximately how many hours of INDIVIDUALIZED INSTRUCTION — that is, one-on-one 
instruction with a teacher or tutor — did this client receive during the three-month period 
following enrollment? 

Imts 



16. i^proximately how many hours of SMALL GROUP INSTRUCTION did this client receive 
during the three-month period following enrollment? 

hours 

17. Approximately how many hours of COMPUTER-ASSISTED INSTRUCTION did this client 
receive during the three-month period following enrollment? 

hours 

18. In which of the following educational programs did this client participate during the three- 
month period following enrollment? (Circle ail that apply.) 

1 General Educational Development (GED) 

1 Adult Secondary Education 

1 Adult Basic Education (ABE) 

1 English as a Second Language ^L) 

1 Employabilily skills 

1 Life skiUs 

1 Self-esteem 

1 Other (Specify: ) 

19. Did this client take ANY PART of the GED or GED practice test(s) on MORE THAN ONE 
OCCASION during the three-monft period following enrollment? 

0 No [GO TO QUESTION 21] 

1 Yes 



20. Please enter this client's scores for the FIRST and LAST administration of the GED or GED 
practice tests during the three-month period following enrollment (Enter first and last scores 
for individual GED test areas if this client was not examined in all areas.) 



- GEDTE^AREA 


TESTSCORES 


NUMBER OF ; i 
HOURSt>F^ ? ij 

iNsmticrnoN | 

BETWEEN l?ESt 1 
ADMINISTRATIONS^ 


. firrt • 
ilidntfnistratioii 


^ .'Last 
Admlolstratioii 


MATH 








SCIENCE 








WRITING 








SOCIAL STUDIES 








UIERARY ARTS 









Did this client increase his/her educational level during the three*month period following 
enrollment? (Note: Uvel I ^limUed bask skills competent or functioning a 
equivalent and Level 11 = competent, but not proficient, orfimctioning at grades 9-12 
equivalent) 

1 Yes, moved up within Level I 

2 Yes, moved firom Level I to Level n 

3 Yes, moved up within Level n 

4 No increase in educational level 
8 No record exists 



If this client received ESL instruction, did he/she move up one or more levels during the three* 
month period following enrollment? 



0 No 

1 Yes 

7 Not s^licable/did not receive ESL instruction 

8 No record exists 



Did this client accomplish one or more of his/b^ personal goals during the three-month period 
following enrollment? 



0 No 

1 Yes 

8 No record exists 

Did this client receive literacy instruction in any of the following LIFE SKILLS during the 
three-month period following enrollment? (Circle the number to the left of all that apply.) 
How much progress did he/she make toward the successful completion of instruction in each 
life skill area? (Circle the appropriate number to the right of each life skill area for which 
instruction was received.) 



Consumer Economics 

1 Weights, measures, coins, 
and currency 

1 Comparison shopping/ 
coupons 

1 Locating/obtaining housing 

1 Personal budgeting/ 
financial services 



No 

No Some Much Successfully Record 
Progress Progress Progress Completed Exists 



2 
2 



3 
3 



4 
4 



8 

8 
8 



Community Resources 

1 Telephone/telephone 
directory 



4 8 
(Continued next page) 
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PntniT^lini^ ResOUTCeS 
1 



No 

No Some Much Successfully Record 
Progress Progress Progress Completed Exists 



Transportation/travel 
information (i.e., m^s, 
sdiedules, etc.) 

Conmiunity agencies and 
services 



Occupational Knowledge 

1 Locating employment 
opportunities 

1 R6sum6s. job applications, 
and letters of plication 

1 Job interview skills 

flnvemment and Law 
•1 Voting/political process 
1 Legal rights/responsibilities 
1 Taxation 



Health 

1 

1 

1 

1 



Basic health and safety 
Medications 
Nutrition 
Personal hygiene 



Social Skills 

1 Commimication/social 
interaction 

1 Decision-making 

1 Leadership 

1 Parenting 



2 
2 

2 

2 
2 

2 
2 
2 
2 



2 
2 
2 
2 



3 
3 

3 
3 
3 

3 
3 
3 
3 



3 
3 
3 
3 



4 
4 

4 
4 
4 

4 
4 
4 
4 



4 
4 
4 
4 



8 
8 

8 
8 
8 

8 
8 
8 
8 



8 
8 
8 
8 



ERIC 



244 



Did this client accomplish any of the following during the three-month period following 
eniolhnent? (Circle the appropriate number to the right of each response.) 



No 
Record 

No Yes Exists 



Received GED 0 1 8 

Received Adult Secondary Education diploma 0 18 

ObtainedAmproved employment 0 18 

Got off welfare 0 18 

Gained admission to another education/training program 0 18 

Registered to \ ote for the first time 0 18 

Obtained U.S. citizenship 0 18 

Obtained a driver's license 0 18 

Found a place to live 0 18 



IV. SEPARATION FROM PROGRAM 



Was this client still participating in the AEH {MDOgram three months after enrollment? 

0 No 

1 Yes [STOP HERE] 

How many days after enrollment did this client separate firom the AEH program? 
days 

What was the PRINCIPAL reason for this client's separation firom the AEH program? {Circle 
the ONE answer that best applies.) 

1 Met educational objectives 

2 Program did not meet client's educational needs 

3 Took a job 

4 Entered another educational/training program 

5 Forced to leave shelter/transitional housing because of stay limitation 

6 Forced to leave shelter/transitional housing for other reasons 

7 Left shelter/transitional housing voluntarily 

8 Moved out of the area 

9 Experienced difiBculty obtaining child care 

10 Ex perienced difiBculty obtaining transportation to instructional site 

11 Incarcerated 

12 Institutionalized due to mental illness or drug/alcohol abuse 

13 Client's fear of failure regarding education 

14 Other (Specify: ) 

98 No record exists 

THANK YOU FOR YOUR PARHQPATION! 
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INSTRUCTIONS FOR ADMINISTERING THE 
TALS DOCUMENT LITERACY TEST 



Using the Scrq^t: 

Text in bdld print indicates instmctaons for you to follow as 
yoii administer tha t^ 

Text in Titular typeface indicates directions that you are to 

Text that is i(a2icize</ indicates ^dso printed 

in the examinees^ test^bodl^^ 
aloiui wh^ 



SCRIPT 

Introduction to read before distributing books: 

The test you are about to take will provide information about how well you can 
apply literacy skills so that we can help you meet your goals. You will be asked to 
answer questions based on the kinds of printed materials adults come into contact with 
on a daily basis. 

The test that you will be taking will provide information about your skills in 
identifying and using infomiation in materials such as tables, charts, maps, and forms. 

Now I am going to hand out the test booklets and pencils. Please put your 
booklet face up. Do not open it until I tell you to do so. 

Distribute an assessment booklet and two pencils to each examinee. Then read 
the following. 

Open the booklet to the inside front cover. Fill in your name and the date on 
the lines provided. 



1 
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Pause to give examinees a ciiance to fill in the information. Then continue 
reading. 

Please read along silently as I read the directions aloud. 

In this test you will answer the questions in several ways. For some you will 
write your answers on the lines provided For others you will indicate your answers 
by circling or uruierlining a sentence or word The directions will explain how and 
where you are to answer. Do not write your answers on the blanks at the bottom of 
the pages. 

Now look at page one. (Pause.) Read the directions and answer the practice 
questions. When you finish, wait for an explanation of the answers. 

Pause to give examinees time to complete the practice questions. 

For practice question number one, you should have placed an X next to or over 
the rectangular box next to the words "authorized signature " For practice question 
number two, you should have circled the date 06/91. 

Now look back at the inside front cover and follow along as I continue lo read 
the directions. 

No one is expected to be able to answer correctly all of the questions in this 
test; however, it is important that you try to answer each one. I am not allowed to 
help you with anything specifically related to completing a question, so if you cannot 
answer a question, go to the next one. Do not spend a lot of time on one question if 
you find it difficult; we would like you to try as many of them as possible. 

Each booklet has two sections. The beginning of each section is indicated at 
the top of the first page with the section number in dark print. Ths?. end of each 
section is indicated by a STOP sign. 

You will have 20 minutes to complete each section. I will tell you when to 
begin each section and when to stop. If you complete a section before time is up, you 
may go back to work on any questions you skipped in that section. If you finish 
working on Section One before time is up, leave your booklet open at the page with 
the STOP sign, and wait until you are told to go on to Section Two. If you finish 
Section Two before time is up, please close your test booklet. If you need another 
pencil after we begin, please raise your hand 

Do you have any questions? 
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Now turn the page to Section One* Please begin* 

Time the section for 20 minutes. At the end of 20 minutes, read the following. 

Stop, even if you have not finished Section One. Please turn to Section Two 
your booklet and begin working on it 

Time the section for 20 minutes. At the end of 20 minutes, read the following. 

Stop, even if you have not finished Section Two* 

Collect the booklets. The session for the administration of the test is now 
completed. 
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ADMINISTERING THE TALS DOCUMENT LITERACY TEST: 

QUESTIONS AND ANSWERS 



Q: To whom should I administer the test? 

A: The test should be administered to all persons who enroll (i*e., participate for 
the first time) in yom* local AEH program between October 15, 1992 and 
November 14, 1992, with the exception of those who are limited English 
proficient. In the case of limited English proficient enroUees, complete and 
retum tlie EnroUee Information Form, but do not administer the test 



Q: When should I administer the test? 

A: The test should be administered to new enrollees within one week of their 
enroUment. 



Q: May I administer the test to more than one student at a time? 
A: Yes. (Group size should not exceed 25.) 

Q: Where should I administer the test? 

A: The test should be administered in a room large enough to comfortably 
accommodate the expected number of examinees. If possible, the location 
should be free of interruptions, outside noise, and other distractions. 

Q: What materials wiU I need? 

A: You will need one test booklet and two pencils (with erasers) per examinee, the 
attached test administration instructions, and a clock or watch. 



Q: How long are examinees permitted to work on the test? 

A: The total time for the test is 40 minutes — 20 minutes for each section. You 
should continue from one section to the next without a break. 



Q: Must examinees take the entire test at one sitting? 



A: 



Yes. The test was validated for a single session of 40 minutes, timed in two 
20-minute sessions. 



Q: Should I encourage examinees to try to answer each question? 

A: Yes. 

Q: May I provide help once the test has started? 

A: No. 

Q: Whom should I contact if I have any further questions? 

A: You may contact Dr. Darrel Drury, of Pelavin Associates, for assistance. He 
can be reached at (202) 785-3308 between 9:00 a.nL and 5:30 p.m. (Eastem 
time), Monday through Friday. You also may direct your questions to the 
director of your state's Adult Education for the Homeless Program, who has 
received training in the administration of the TALS Document Literacy Test 

Q: How and when should I return the completed test booklets and EnroUee 
Information Forms? 

A: Please return the completed test booklets and Enroll^e Information Forms to 
Pelavin Associates no later than November 21, 1992.. (Remember to write a 
unique two-digit ID # on the cover of each test booklet and on the 
corresponding Enrollee Information Forms.) 

Mail (1st Class) to: 

Dr. Darrel W. Drury 
Pelavin Associates, Inc. 
2030 M Street, N.W., Suite 800 
Washington, DC 20036 
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Practice Questions 



Read the directions and answer the practice questions. When you 
finish, wait for an explanation of the answers. 

Refer to both sides of the credit card below to answer the following 
questions. 

!• Place an X in the space where you would sign your name on the 
credit card. 



2« Circle the month and year through which the credit card is good. 






P R 



E F E R R 



E D 



5833 9401 





GOOD 

tmu 




V 



85 07/90 
MADELINE MILLER 



06/91 



Ely 



r 



STATEBANK^\ 



A STA7BCORP COMPANY 



mwiM'— iiw.iiiiuiwumiwmTjAii 



48725707 




AUTHOIIZED 
II6NATUU 
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Section 1 



This section has 13 questions. You will have 20 minutes to complete 
them. 

Refer to the chart on the next page to answer the following questions. 



1. Which sutes have the youngest minimum driving age for a 
regular license? 



2. Between what dates is it permissible to use studded tires in 
California? 



3. Which sutes specify mandatory use of child restraints for chil- 
dren under the age of 4? 



4. Suppose you are planning to drive in both Georgia snfi Florida in 
one day. When you compare the driving regulations <»f the two 
sutes, which regulations are different? 



1. 
2. 
3. 
4. 
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Driving Regulations 



Mm. OrMtf Af«- 



UNITEO STATES 





16 


$5 


YtS 


ANyr:niMron(y. 


Yas 


Unoarage4 


No 


AUiM 


ie(i4) 


S$: uAsurtacad. SO. 


No 


SapL154layl; 
S<9t30-Apr.15s.oflO*N. 


Yas 


Unoaraoa/ 


No 


Amona 


18(16) 


55 


Yas 


Oct.1<May1. 


Yas 


UndaraoaS 


No 


Arkansa 


ie(i4) 


S5 




Nov. 15-Apr. 15. 


Yto 


Unoaraoa6. 


No 




18(16) 


S5 




Nov. 1«Apr. 1. 


Yas 


Under ape 4. ortass 
than40tos. 


Yto 


Coiondo 


21 (16) 




Yas 


No ftHfictions. 


Yas 


Undtraoaloriass 
than 40 Its. 


Yas 


Conntcticut 


18(16) 


55 


No 


Nov. 15^. 30. 


Yas 


Ufidaraoa5. 


Vte 


Daiawart 


18(16) 


55on4*lanc:$0ofi 
2-lana. 


No 


Oct. 15^. 15. 


Yte 


UndaragaS. 


No 


DC. 


18(16) 


25. ajtttpt ottiafwiat 


No 


Oct. 15-Apr. 15. 


Yto 


Ufidaraga4. 


H% 


Ronda 


18(16) 


55 


Vto 


ANyntypaatftattfo 
Moc tfatnioatavyt. 


Yas 


Uiidcraea6. 


YlS 


Gaor9» 


18(16) 


55 


No 


OMyduhnQiiiowor 
KacomMiofia. 


Yas 


Ufldafaoa5. 


No 


Hawaii 


18(15) 


55 


No 


ProhiMad. 




UAdara0a4. 


Yas 


tda)K) 


16(14) 


55 




Oct. 1-Apr. 15. 


Yas 


Ufidaraoa4. 
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Refer to the map on the next page to answer the following questions. 

5. The largest part of the Navajo Indian Reservation is in what 
sute? 

6. On what river is Bluff, Utah, located? 

7. In which state is Mesa Verde National Park? 

8. Name the national monuments located in the Navajo Indian 
Reservation. 



9. About how many mil&Sis it from Gallup, New Mexico, to 
Thoreau, New Mexico?. 



10. What is the highway number of the most direct route from 
Flagstaff, Arizona, to the Petrified Forest National Park? 



5. 



6. 



7. 8. 



10. 
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Refer to the chart on the next page to answer the following questions. 

11. If you ate a McDonald's Biscuit w/sausage and egg, you would eat 

grams of fat, calories, and milligrams 

of sodium. 

12. Which breakfast food is the lowest in both fat and calories? 

13. Name two breakfasts that conuin the same number of calories. 



11. 
12. 
13. 
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Breakfast in the slow lane 



W Begin the day with a typical fast*food breakfast and you fill up on nutritional undesirables. Cold cereal and 
toast, on the other hand, wreak little nutritional damage. A 1 ounce serving of an unsweetened cereal like 
cornflakes, with tow*fat milk, banana slices, toast and a doltop of jelly, usually totals out to less than 3 grams of fat. 
544 milligrams of salt and 390 calories. 



CompiM by Jo Ann ToMy with Lynn Andtrson Carte and Marianna I Knight 

A CASE FOR CORNFLAKES 

Most fast-food tKeakfasts are loaded with fat, catories and salt. Here's how a few favorites measure up. 





Cat 

rai 

(grams) 


Calories 


Sodium 
(milligrams) 


Burger King Croissan'wich w/sausage 


41 


538 


1,042 


McDonald's Biscuit w/sausage and egg 


35 


529 


1,250 


Hardee's Sausage and Egg Biscuit 


35 


503 


885 


Burger King French Toast Sticks 


2t 


499 


498 


Roy Rogers Crescent w/Sausage 


29 


499 


1,289 


Jack in the Box Pancake Platter 


22 


612 


888 


McDonald's Egg McMuffin 


12 


293 


740 


Roy Rogers Apple Danish 


12 


249 


255 


McDonald's Hotcakes w/butter and syrup 


9 


413 


640 


McDonaM's English Muffin w/butter 


5 


169 


270 



USMWR-Btt^ data: Mayo Clinic Numon UafrraprinM wittt iMrmission from Mayo Foundation tor Madical Education and Rttaarch 
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Section 2 

This section has 9 questions. You will have 20 minutes to complete 
them. 

Refer to the list on the next page to answer the following questions. 

1. Which city ranked fourteenth |14th) in 1989? 

2. Which city was ranked 11 8th in 1988? 

3. How many of the cities listed were not ranked in 1988? 

4. Which city was ranked the same in 1988 and 1989? 

5. Which sute had the most cities ranked in the top 50 for 1989? 



1. 
2. 
3. 
4. 
5. 
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METRO REPORT 



HOT SPOTS 

In this year's ranking of metropolitan economies, growth is in the 'edge cities' 



METRO RANKING 1989 Rank ^uui 1938 n.u-ik 



1. ManchMitr-Nathua. NH (2) 


26. 


OaMaa-Ft. WMh. TX (9) 


2. Onando. Ft (3) 


27. 


vantura CA(NR) 


3. Wtst Palm Btacti. Ft (NR) 


28. 


fliiflinfann ifcimrwihai VT (NR) 


4. R«)tigh-Ourtiam. NC (6) 


29. 


Charlotta. NC (32) 


5. Wathmgion. DC (8) 


30. 


Ric»Nnond.VA(25) 


e.UttVtgas.NV (27) 


31. 


Rano. NV (73) 


7. Atlanta. OA (5) 


32. 


indtmpokt. IN (35) 


8. Anahatm. CA (NR) 


33. 


Tampa-St. Patwaburg, Ft (15) 


9. Ponsmouth. NH (13) 


34. 


Saraaoto. Ft (29) 


10. Phoanix,AZ(4) 


35. 


Bailimora. MO (24) 


11. San Otago. CA(10) 


36. 


Wilminvtongrjksonvata. NC (NR) 


12. Rivaftida-San Bamadmo. CA (NR) 


37. 


CokMnbua.OH(3i) 


13. SanJoaa. CA (NR) 


38. 


Gainaavitta. Ft (NR) 


14. Ft. MyafS. FL(17) 


39. 


Poraand. ME (37) 


15. NasftviHa.TN(ll) 


40. 


El Paao.TX(26) 


16. JacKaonvil(a.Fl(22) • 


41. 


Qraanaboro-Wintion Salam. NC (28) 


17. Austin. TX (1) 


42. 


^MlminQlon, DE (36) 


8. Nortolk-PortSfTiooth. VA(20) 


43. 


Saatiia.WA<40) 


19. ChaHaston. SC (19) 


44. 


South Band. tN (18) 


20. Calumba. SC (45) 


45. 


Ft. Wayna. tN (38) 


21. Ft. Piafca. FL (NR) 


46. 


AoanacC(ty.NJ(ii8) 


22. HunUviNa. At (7) 


47. 


Mont9omafy.At(8l) 


23. Panama C<ty-Ft. Walton Baach. Ft (NR) 


48. 


Pantaooia.Ft(i6) 


24. taxmgion. KY (47) 


49. 


Sacramamo. CA (46) 


25.Tusoon.AZ(12) 


50. 


M»nnaapolii-St. Paul. MN (34) 
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Use the form on the next page to answer the following question. 



6. Complete the application for the nondriver ID card on the next 
page. In doing so assume the following: 

• Luke M. Girard is applying 

• mailing/legal address is 3725 Poplar Street, Rochester, New 
York 14620; county of Monroe 

• never possessed a New York State license or ID card 

• bora January 26, 1972 

• 5 feet; 9 inches tall 

• brown eyes 

You do HQS have to sign name. 



6a. 



b. 



c. 



e. 
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State of New York - Departn<ent of Motor Vehicles 
APPLICATION FOR THE NONDRIVER ID CARD 

PLEASE PRINT WITH BLUE OR BLACK INK IN BLANK SPACES NEXT TO ARROWS, 

DO NOT PRINT IN SHADED AREAS 



LAST NAME 



FIRST NAME 



MOOtE INfTIAL 



SHAOEOAflEAS 



1 ..I , I 



Month 



DATE OF 

imTH 



± 



± 



M F 

□ □ 



J — I — I I l_J_L 



OUomeSumMdMd 



Doyoocurftmh^h«vtaN«wYofKStattMcen«eof lDca«^^ □ LICENSE Slb^Aftb 
If $0. 0nt0r th0 identification nun^r 0xscHy as it appaars on the kcenaa or ID card. 



E 



' « « ' « 



tilt 



« « ' ' 



NUMBER AND STREET (Mailing AddfM* including Rural OMvwy. Box No. andw Apt. No.) 



,1 ( I 



CITY OR TOWN 



J I I l__L 



J 1 1 I I I L 



STATE 



J I L 





1 1 1 1 1 t 1 1 1 


1 1 1 


111 1 1 




ZIP CODE 


COUNTV OF RESIDENCE 




h 


1 1 1 1 


1 1 1 









Ltgai Address H diffef tnt from MiHioq Address 



AlOmCNT LAM 
RENEMWL IM 
OUPUCArE i» 
OmOMAL Ui 



NOHMVERD 



N(>FCE m 
WNEWMLUPOATE UP 
UCBI8E8UR U 



Fee 

% 



Appmedby 



.HEIGHT 



EYE COLOR 



I 



%vCetor 



AMENDMENT To ehenoe yeur pceeem K> eerd. 1IH in t«M eectlon 

«. f'oraehanoaotnam,pnntyour1ommnmm9x9Ctiyaait^)paanonyourpf^ 



test Name 

b. If other than abova.givachanoa and reason , 



First 



Middle ifHtial 



1^ 



CmMw 
SignMura. 



1, the undersipied state that the information I have given on the foregoing application is true to the best of my 
knowledge and belief. If a valid New York State driver's license is assigned to me, I certify that I have surrendered 
It with this application. If a duplicate ID card is being applied for, I certify that I am the holder of a currently valid 
or renewable New York Sute ID card that is not presently under suspension or revocation, and that this ID card 
has been lost, mutilated or destroyed. If the lost ID card is found after the duplicate ID card has been issued I will 
suncndcr the found ID card to the Department of Motor Vehicles and advise that a duphcate has been issued 



SIGN V 
HERE A - 



Sign nam« in Full - A mamad woman must ust h«r own first namt. 



MV-44IO(«t4| 
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Refer to the graph on the next page to answer the following questions. 

7. Which television show on the chart is broadcast by ABC? 

8. Which program attracts more than 20 percent of women viewers? 

9. What percenuge of the female audience watches "A Different 
World"? 



7. 
8. 
9. 



Page 12 



GO ON 10 NIXT PAGF 



Women's most-watched TV shows 




Page 13 2B4 



BEST COPY AVAILABLE 



(DO NOT WRITE IN THIS SPACE) 



ENROLLEE ID NUMER: 

Enter a unique two-digit ID # here and on the cover the examinee's test booklet For the first 
new enrollee, enter **0L " For subsequent enrollees, enter **02, " **03, " etc. 

SITE NAME: 

LOCAL PROGRAM: I 1 



■j INSTRUCTIONS : Please complete this form for each person who enrolls (Le., participates 

I for the first time) in the AEH program between October 15, 1992 and November 14, 1992. 

Leave questions blank or circle ** Don't know, " if the information is unavailable or if you are 
ijm not certain of the correct response. After administering the TALS Document Literacy Test to 

P each new enrollee (see exception below), write the enrollee's two-digit ID# on his/her test 

booklet and return both forms. In the case of limited English proficient enrollees, complete 
^ and return the Enrollee Information Form, but do not administer the test. 

1. Is this enrollee limited English proficient? 

I 0 No [COMPLETE THIS FORM AND ADMINISTER TEST] 

■ 1 Yes [COMPLETE TfflS FORM, BUT DO NOT ADMINISTER TEST] 

I 2. Sex: 

1 Male 

■ 2 Female 

3. Race/etlmicity: 

■ 1 White (not of Hispanic origin) 

2 Black (not of Hispanic origin) 

■ 3 Hispanic 

I 4 Asian or Pacific Islander 

5 American Indian or Alaskan Native 

■ 6 Other (Specify: ; ) 

I 8 Don*t know 

ERIC 



Age at enrollment: 

years 

Family status at enrollment: 

1 Single/widowed/divorced (no dependent children) 

2 Single/widowed/divorced (dependent children) 

3 Married (no dependent children) 

4 Married (dependent children) 
8 Don't know 

Employment status at enrollment: 

1 Employed full-time [GO TO QUESTION 8] 

2 Employed part-time [GO TO QUESTION 8] 

3 Unemployed 

8 Don't know [GO TO QUESTION 8] 
Number of months imemployed at enrollment: 

months 

Number of months homeless at enrollment: 

months 

Educational level at enrollment: 

1 Level I (limited basic skills competent or functioning at grades 0-8 

equivalent) 

2 Level n (competent, but not proficient, or functioning at grades 9-12 

equivalent) 
8 Don't know 

Number of years of education at enrollment (circle highest grade completed): 

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17+ 



PLEASE REMEMBER TO WRITE THE EXAMINEE'S 
ID NUMBER ON THE COVER OF THE TEST BOOKLET. 



THANK YOU! 



APPENDIX D 

Statistical Methods and 
Detailed Results for Analysis of 
Client Participation 
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statistical Methods and DetaUed Results for Analysis of 
Client Participation 



We used lelated methods to obtain adjusted estimates of the average amount of instruction 
clients receive and to assess the impact of various traits on the amount of instruction received. 
Both methods assume that the hours of instruction received assumes a Weiball distribution. The 
Weibull distribution is a fairly flexible, two-parameter distribution conunonly used to model 
duration data (Lancaster, 1990).^ The methods are outlined below. 

Ad jiisted Hours of Instmction Received 

The method of maximum likelihood was used to estimate the parameters of the Weibull 
distribution. The likelihood function is constructed in two parts: the first part represents the 
contribution to the likelihood function from completed spells, and the second part represents the 
contribution from incomplete spells. Letting represent the total time in the program for 
individual i, have, 

Li = P(t=tjp,0) 

for the completers, and, 

L, = P(t^:tilP,0) 

for incomplete spells. The probability is given by the Weibull density function in the first case, 
and by the survivor function in the second case. The product over all individuals gives the 
overall likelihood function. Maximization with respect to the parameters ^ and a yields the 
maximum likelihood estimates. The mean is derived from these parameters. Estimation 
employed the Weibull procedure in the statistical software Stata. 

Impact of Various Traits on Instmction 

Survival models provide an appropriate framework for analyzing duration data (such as the 
hours of instruction). These models are commonly developed in terms of the hazard rate, which 
can be interpreted as the probability of leaving during a given (small) time interval given survival 
until that interval. One form of survival model is a proportional hazards model, which breaks the 
hazard rate into two components: the baseline hazard shared across individuals, and the 
individual specific factors that influence the overall hazard rate. Typically, these factors enter the 
equation by making proportional changes in the hazard rate. Letting the Q^t) represent the hazard 
rate for individual i at time t, the model takes the form: 



^ Lancaster, T. (1990), Er-nometric Analysis of Transition Data, Cambridge: Cambridge 
University Press. We also .lated the multivariate model using a semi-parametric method that 
does not require the distri^^^ jnal assumption and we found no substantive differences with the 
results reported here. 
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6i(t) = eoCxpLp^Xj] 



where ^ represents a vector of parameters to be estimated and is a vector of characteristics of 
individual i, or the program in which he or she is enrolled. The exponential functional form 
ensures that the proportional effect on the baseline hazard remains positive (a constraint inherent 
in the nature of a probability).^ 

This form of the basic survival model is completed by specifying the functional form of 
the distribution of the hours of instruction. As discussed above, we assumed a WeibuU 
distribution. 



The final modeling issue is the issue of censored data and the meaning of leaving the 
program. Some clients had not completed their spell of education at the time the study ended. 
The survival model outlined above can easily accommodate multiple destinations (completing or 
leaving otherwise) and censoring. We simply break the hazard function out into two separate 
'transition intensities/' 

m = e„(t)+e2i(t) 



so the probability of leaving at time t (given survival until time t) is the sum of the probability of 
leaving for destination one or destination two (also conditional on survival). The density function, 
which gives us the observation's contribution to the likelihood function in a maximum likelihood 
analysis is given by, 



2 ^ 



k-l 0 



for clients who leave for state k (either completing or otherwise leaving). What we know about 
the censored observations is that they have "survived'' for at least as long as their observed 



^ Note that this does not imply that characteristics cannot reduce the hazard: when the 
proportional effect is less than one, the hazard is reduced. 

^ The survivor function, the probability of not leaving before time t, is related to the hazard 



function as follows: F(t) = exp 



-/e(s)d(s) 



By deHnition, the hazard function is given by the 



density function over the survivor function. Therefore, the distribution function is given by. 



F(t) - e(t)exp 
log likelihood 



-/e(s)d(s) 



Thus, the likelihood function is the product over these terms, and the 



'ollows immediately as the sum of the log of these terms. Lancaster (1990) 



provides an excellent introduction to these models. 
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duration. These observations contribute to the likelihood function the probability of surviving at 
least until t: 



1^ ^ txp 



We thus exploit the information that we have about the censored observations without resorting to 
counterfactual assumption that the spells are complete. 

Replacing the 6 with the specific functional form of the WeibuU model yields an easily 
estimable model. 



We transformed continuous variables into thek natural logarithms when they entered the 
model, and reparameterized the model to estimate 'time ratios/' that is, the proportional effect of 
the explanatory variables on the expected hours of instmction. With these changes, the 
coefficients represent elasticities of expect hours of instruction with respect to the continuous 
variable associated with the coefficient. The coefficients associated with dummy variables must 
be exponentiated and one subtracted to be interpreted as elasticities. The table in the text has 
already taken this step. Table D-1 presents the coefficient estimates, and Table D-2 provides a 
more complete description of the variables included in the analysis. The analysis included cases 
aU cases with complete data that met two conditions: the client received some instruction and the 
data indicated an average of fewer than 10 hours per day of instmction. The latter condition 
excluded a few cases in which the data were clearly in error. 
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TABLE D-l 



ESTIMATES FROM WEIBULL REGRESSION MODEL 



Weibull regression {log expected time form) 
Sigma =: 1.189 

Std Err (Sigma) = 0.031 

x^og Likelihood = -1950.123 



Number of obs 
Model chi2{23) 
Prob > chi2 
Pseudo R2 



1808 
= 578.102 
= 0.0000 
= 0.2388 



clql4 1 


Coof . 


Std. Err. 




t 


P>|t| 


[95% Conf. 


Interval] 


hsgrad 1 


-.145319 


.1061669 


-1 


.369 


0 


^ 171 


-.3535435 


.0629055 


.level i 


.3988479 


.0996312 


4 


.003 


u 


Aft ft 


.2034/18 


.594254 


female ! 


.1827508 


.098254 


1 


.860 


0 


.063 


-.0099542 


.3754559 


InAge I 


.3959344 


.1564883 


2 


.530 


0 


.011 


.0890148 


.702854 


InNoJb i 


-.0059918 


.066206 


-0 


.091 


0 


.928 


-.1358413 


.1238578 


nojob2 1 


-.2459064 


.2013592 


-1 


.221 


0 


.222 


-.6408311 


.1490182 


employ 1 


-.0962897 


.2064726 


-0 


.466 


0 


.641 


-.5012434 


.3086639 


nohome 1 


-.5918883 


.1493739 


-3 


.962 


0 


.000 


-.8848545 


-.2989221 


InNoHm 1 


.1284692 


.059719 


2 


.151 


0 


.032 


.0113426 


.2455957 


resident I 


-.0510926 


.1324678 


-0 


.386 


0 


.700 


-.310901 


.2087158 


compuls 1 


.0537129 


.1158015 


0 


.464 


0 


.643 


-.173408 


.2808338 


InFacRat I 


-.2916041 


.0549507 


-5 


.307 


0 


.000 


-.3993786 


-.1838296 


InPctSrol 1 


-.3487878 


.0815927 


-4 


.275 


0 


.000 


-.5088151 


-.1887604 


InPctlnd 1 


-.5132652 


.0639996 


-8 


.020 


0 


.000 


-.6387873 


-.3877431 


pctMis 1 


.8572763 


.1354036 


6 


.331 


0 


.000 


.59171 


1.122843 


InDegree I 


.1650377 


.0817958 


2 


.018 


0 


.044 


.0046122 


.3254633 


drgabus 1 


.567891 


.1203938 


4 


.717 


0 


.000 


.3317633 


.8040187 


spsabuse I 


-c3382935 


.153787 


-2 


.200 


0 


.028 


-.6399151 


-.0366719 


rural 1 


.6951709 


.1880484 


3 


.697 


0 


.000 


.3263527 


1.063989 


city 1 


.3233972 


.1079857 


2 


.995 


0 


.003 


.1116054 


.535189 


academic I 


1.041383 


.110U328 


9 


.396 


0 


.000 


.8240074 


1.258759 


clqlSf 1 


1.064733 


.1232513 


8 


.639 


0 


.000 


.8230008 


1.306465 


clql8d 1 


.9679661 


.2471922 


3 


.916 


0 


.000 


.4831492 


1.452783 


_cons 1 


.906036 


.5827497 


1 


.555 


0 


.120 


-.2369078 


2.04898 



(standard errors conditional on sigina) 
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TABLE D.2 



VARIABLE DEnNITIONS 

hsgrad 1 if client entered with at least 12 years of prior instruction, zero otherwise 

level 1 if client entered with Level I skills, 0 otherwise 

female 1 if client was feniale, 0 otherwise 

InAge logarithm of reported age 

InNoJb logarithm of reported length of time tmemployed if unemployed and data available, 
0 otherwise 

nojob2 1 if client was unemployed but length of unemployed was unavailable, 0 otherwise 

employ 1 if client was employed, 0 otherwise 

nohome 1 if duration unemployment was unavailable, zero otherwise 

InNoHm logarithm of months of unemployment if available, 0 otherwise 

resident 1 if site was residential, 0 otherwise 

compuls 1 if site required participation for residence, 0 otherwise 

InFacRat logarithm of ratio of new entrants in June to reported number of faculty 

InPctSml logarithm of the proportion of all hours received provided in small group 

instruction if available, 0 otherwise 

InPctlnd logarithm of the proportion of all hours received that were provided in individual 
instruction if available, 0 otherwise 

pctMis 1 if proportion of instruction remved in different settings was unavailable 

InDegree logarithm of the proportion of staff members with a college degree 

drgabus 1 if site serves primarily people recovering from drug or alcohol abuse, zero 
otherwise 

spsabuse 1 if site serves primarily victims of spousal abuse, 0 otherwise 
rural 1 if site is in rural location, 0 otherwise 
city 1 if site is in urban location, 0 otherwise 
academic 1 if client is enrolled in ABE, ASE, or GED program, 0 otherwise 
clqlSf 1 if client is enrolled in life skills program, 0 otherwise 
clqlSd 1 if client is enrolled in ESL program, 0 otherwise 
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Detailed Results from Multivariate Analysis of Academic Improvement 



This ^pendix presents the detailed results from the two probit analyses presented in the 
text. Table E-1 presents the complete estimates from the model of predictors of reported 
improvement. Table E-2 presents complete results from the model of predictors of achieving a 
GED. Table E-3 defines the variables included in the analyses. 

One compulsory site reported that every one of their 86 clients had improved (increased 
within level or moved from Level I to Level n). Some of these clients had as few as four hours 
of instruction. Clearly, this site is an outlier, and probably reflects an overly-generous instructor's 
assessment. Therefore, clients from this site were excluded from this analysis. 



TABLE E-1 



PROBIT MODEL OF FACTORS INFLUENCING 
ACADEMIC IMPROVEMENT 



Probit Estimates 



Log Likelixiood = -765.24133 



Number of obs = 1533 

chi2(27) = 529.52 

Prob > chi2 = 0.0000 

Pseudo R2 =0.2570 



improve 1 


Coef . 


Std. Err. 




z 


P> 


Izl 


hsgrad 1 


-.2606577 


.0869741 


-2. 


997 


0. 


003 


level 1 


.3757731 


.0833453 


4. 


509 


0. 


000 


female 1 


-.0730457 


.0847496 


-0. 


862 


0. 


389 


dage I 


.0009424 


.0039187 


0. 


240 


0. 


810 


no j obi 1 


-.0046902 


.0026183 


-1. 


791 


0. 


073 


nojob2 ! 


-.0878691 


.1286933 


-0. 


683 


0. 


495 


employ 1 


.162664 


.1230424 


1. 


322 


0. 


186 


nohome 1 


.0599505 


.1204012 


0. 


498 


0. 


619 


nohomel 1 


.000213 


.0034057 


0. 


063 


0. 


950 


resident 1 


-.05731 


.1046153 


-0. 


548 


0. 


584 


compuls 1 


-.1778842 


.1143489 


-1. 


556 


0. 


120 


indlnst 1 


.0278939 


.0039706 


7 


025 


0. 


000 


grplnst 1 


-.0001363 


.0014329 


-0 


095 


0. 


924 


calnst 1 


.0067282 


.0062433 


1 


078 


0 


281 


otherhrs 1 


.0058279 


.0028889 


2 


.017 


0 


044 


tothrs 1 


.0036033 


.0011886 


3 


.032 


0 


002 


comind 1 


.0185415 


.0120157 


1 


.543 


0 


.123 


comgrp 1 


.0125255 


.0050742 


2 


.468 


0 


.014 


jsratio 1 


-,0089129 


.0043374 


-2 


.055 


0 


.040 


degrees 1 


.0279422 


.1397482 


0 


.200 


0 


.842 


drgabus 1 


-.1910565 


.0912518 


-2 


.094 


0 


.036 


spsabuse 1 


.0132706 


.1357029 


0 


.098 


0 


.922 


rural 1 


-.1965689 


.1297703 


-1 


.515 


0 


.130 


city 1 


.2051184 


.0894691 


2 


.293 


0 


.022 


academic I 


1.215584 


.0979738 


12 


.407 


0 


.000 


clqlSf 1 


.7171981 


.1096008 


6 


.544 


0 


.000 


clqlSd 1 


.5322497 


.1805181 


2 


.948 


0 


.003 


_cons 1 


-1.53452 


.216191 


-7 


.098 


0 


.000 
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TABLE E-2 



PROBIT MODEL OF FACTORS INFLUENCING 
GED CERTIFICATE ATTAINMENT 



Probit Estimates Number of obs = 451 

chi2(21) = 77.28 

Prob > chi2 = 0.0000 

Log Likelihood = -170.61795 Pseudo R2 = 0.1846 

Dependent variables 1 if GED received, 0 otherwise 

Only clients enrolled in GED or ASE included in the analysis 



CK^Zba 1 


Loei . 


buu. £«rr • 




z 


P>lz| 


level 1 


1.124014 


.2084419 


5. 


392 


0, 


000 


female I 


-.5284883 


.187974 


-2, 


811 


0 


005 


dage I 


.0062377 


.0086842 


0, 


718 


0 


473 


no j obi 1 


.004688 


.00902 


0, 


520 


0 


603 


nojob2 1 


.0972977 


.2596026 


0 


375 


0 


708 


employ I 


1769837 


.2819755 


-0 


628 


0 


530 


nohome 1 


-.3997637 


.2494086 


-1 


€03 


0 


.109 


nohomel 1 


-.0232601 


.0171933 


-1 


353 


0 


176 


resident 1 


-.4201995 


.2233625 


-1 


881 


0 


.060 


compuls 1 


.2341306 


.2103092 


1 


113 


0 


.266 


indlnst 1 


-.0009036 


.0025004 


-0 


.361 


0 


.718 


grplnst 1 


.0047461 


.0026362 


1 


.800 


0 


.072 


calnst 1 


.0200009 


»0139863 


1 


.430 


0 


.153 


otherhrs I 


.0042611 


.0032425 


1 


.314 


0 


.189 


tothrs 1 


.0057781 


.0018045 


3 


.202 


0 


.001 


jsratio 1 


-.0048046 


.0131323 


-0 


.366 


0 


.714 


degrees I 


-.3310117 


.336443 


-0 


.984 


0 


.325 


drgabus j 


-.2578589 


.2117604 


-1 


.218 


0 


.223 


spsabuse 1 


.5858627 


.2795832 


2 


.095 


0 


.036 


rural 1 


-.0425706 


.3245287 


-0 


.131 


0 


.896 


city 1 


-.2433138 


.1830953 


-1 


.329 


0 


.184 


_cons I 


-.8985449 


.4249462 


-2 


.114 


0 


.034 



Test of hypothesis that coefficients for all types of instruction are zero (that is, that gross amount 
of instruction does not matter for those students for whom breakdown in available. Tnis 
hypothesis can be safely rejected (therefore, we infer that amount of instruction does matter). 

test grplnst+calnst+indlnst+otherhrs=0 ; 

(1) indlnst + grplnst + calnst + otherhrs =0.0 

chi2{ 1) = 4.24 
Prob > chi2 = 0.0394 

Test of hypothesis that the impact of an hour of instruction is the dame for the group for whom 
breakdown is available and the group for whom it is not. We cannot reject this hypothesis. 
Therefore, we infer that the impact of gross instruction is consistent across groups. 

test grplnst +calnst+ indlnst +otherhrs=tothrs ; 

(1) indlnst + grplnst + calnst + otherhrs - tothrs = 0.0 

chi2( 1) = 2.68 
Prob > chi2 = 0.1017 



TABLE E.3 



VARIABLE DEFINITIONS 



hsgrad 1 if cUent entered with at least 12 years of prior instruction, zero otherwise 

level 1 if client entered with Level I stdUs, 0 otherwise 

female 1 if client was female, 0 otherwise 

dage Reported age, recentered 

noJobl reported length of time unemployed if unemployed and data available, 0 otherwise 

nojob2 1 if client was unemployed but length of unemployed was unavailable, 0 otherwise 

employ 1 if client was employed, 0 otherwise 

nohome 1 if duration unemployment was unavailable, zero otherwise 

InNoHm logarithm of months of unemployment if available, 0 otherwise 

resident 1 if site was residential 0 otherwise 

compuls 1 if site required participation for residence, 0 otherwise 

incQnst Hours of individual instruction received if available, 0 otherwise 

grplnst Horns of small group instruction if available, 0 otherwise 

othHrs Other hours of mstruction if small group and individual are available, 0 otherwise 

tothrs Total hours of instruction if breakdown into individual and small group instruction 
are NOT available, 0 otherwise 

comind compuls*indInst if hours of individual instruction are available, 0 otherwise 

comgrp compuls*grpInst if hours of small group instruction are available, 0 otherwise 

jsratio ratio of new June enroUees to total number of staff members 

degrees proportion of staff members with a college degree 

drgabus 1 if site serves primarily people recovering from drug or alcohol abuse, zero 
otherwise 

spsabuse 1 if site serves primarily victims of spousal abuse, 0 otherwise 

rural 1 if site is in rural location, 0 otherwise 

city 1 if site is in urban location, 0 otherwise 

academic 1 if client is enrolled in ABE, ASE, or GED program, 0 otherwise 

clqlSf 1 if client is enrolled in life skills program, 0 otherwise 
clqlSd 1 if client is enrolled in ESL program, 0 otherwise 
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